-- Logs begin at Sat 2022-04-16 20:01:17 UTC, end at Sat 2022-04-16 22:37:31 UTC. -- Apr 16 20:57:02.328749 ncdv-master-1 systemd[1]: Started Devstack devstack@n-super-cond.service. Apr 16 20:57:03.707794 ncdv-master-1 nova-conductor[127856]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 16 20:57:06.364814 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:57:06.423547 ncdv-master-1 nova-conductor[127856]: DEBUG nova.context [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=127856) load_cells /opt/stack/nova/nova/context.py:464}} Apr 16 20:57:06.427736 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_concurrency.lockutils [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 20:57:06.429286 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_concurrency.lockutils [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 20:57:06.430116 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_concurrency.lockutils [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 20:57:06.432067 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_concurrency.lockutils [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 20:57:06.445535 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:57:06.446524 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:57:06.586222 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_concurrency.lockutils [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Acquired lock "singleton_lock" {{(pid=127856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 20:57:06.586634 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_concurrency.lockutils [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Releasing lock "singleton_lock" {{(pid=127856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 20:57:06.587362 ncdv-master-1 nova-conductor[127856]: INFO oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Starting 2 workers Apr 16 20:57:06.592324 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Started child 128731 {{(pid=127856) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Apr 16 20:57:06.597150 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Started child 128732 {{(pid=127856) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Apr 16 20:57:06.598367 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Full set of CONF: {{(pid=127856) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Apr 16 20:57:06.598752 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ******************************************************************************** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 16 20:57:06.599087 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] Configuration options gathered from: {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 16 20:57:06.599478 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 16 20:57:06.599734 ncdv-master-1 nova-conductor[128731]: INFO nova.service [-] Starting conductor node (version 25.1.0) Apr 16 20:57:06.600382 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] config files: ['/etc/nova/nova.conf'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 16 20:57:06.600472 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ================================================================================ {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 16 20:57:06.601145 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] allow_resize_to_same_host = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.601616 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] arq_binding_timeout = 300 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.602055 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] block_device_allocate_retries = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.602474 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] block_device_allocate_retries_interval = 3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.602960 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cert = self.pem {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.603385 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute_driver = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.603897 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute_monitors = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.604407 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] config_dir = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.604859 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] config_drive_format = iso9660 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.605238 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.606191 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] config_source = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.606618 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] console_host = ncdv-master-1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.607030 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] control_exchange = nova {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.607449 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cpu_allocation_ratio = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.607855 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] daemon = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.608291 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] debug = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.608692 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] default_access_ip_network_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.609107 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] default_availability_zone = nova {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.609505 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] default_ephemeral_format = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.610136 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.611769 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] default_schedule_zone = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.612214 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] disk_allocation_ratio = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.612629 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] enable_new_services = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.613079 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] enabled_apis = ['osapi_compute'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.613474 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] enabled_ssl_apis = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.613893 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] flat_injected = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.614295 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] force_config_drive = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.614686 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] force_raw_images = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.615121 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] graceful_shutdown_timeout = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.615532 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] heal_instance_info_cache_interval = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.616390 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] host = ncdv-master-1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.616838 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.617411 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] initial_disk_allocation_ratio = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.617826 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] initial_ram_allocation_ratio = 1.5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.618406 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.618804 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] instance_build_timeout = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.619210 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] instance_delete_interval = 300 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.619609 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] instance_format = [instance: %(uuid)s] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.619990 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] instance_name_template = instance-%08x {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.620416 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] instance_usage_audit = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.621026 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] instance_usage_audit_period = month {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.622162 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.622716 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] instances_path = /opt/stack/data/nova/instances {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.623257 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] internal_service_availability_zone = internal {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.623793 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] key = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.624375 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] live_migration_retry_count = 30 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.624938 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] log_config_append = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.625596 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.626095 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_db.sqlalchemy.engines [None req-08df15e2-9ac1-4f58-bed7-a50875aa7945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:57:06.626294 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] log_dir = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.626903 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] log_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.627367 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] log_options = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.627918 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] log_rotate_interval = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.628515 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] log_rotate_interval_type = days {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.628983 ncdv-master-1 nova-conductor[128732]: INFO nova.service [-] Starting conductor node (version 25.1.0) Apr 16 20:57:06.629624 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] log_rotation_type = none {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.630111 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.630575 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.631121 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.631697 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.632219 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.632803 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] long_rpc_timeout = 1800 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.633329 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] max_concurrent_builds = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.633866 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] max_concurrent_live_migrations = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.634413 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] max_concurrent_snapshots = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.634960 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] max_local_block_devices = 3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.635489 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] max_logfile_count = 30 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.636004 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] max_logfile_size_mb = 200 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.636570 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] maximum_instance_delete_attempts = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.637187 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] metadata_listen = 0.0.0.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.637798 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] metadata_listen_port = 8775 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.638361 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] metadata_workers = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.638902 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] migrate_max_retries = -1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.639450 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] mkisofs_cmd = genisoimage {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.640097 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] my_block_storage_ip = 10.222.0.20 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.640580 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] my_ip = 10.222.0.20 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.641144 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] network_allocate_retries = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.641704 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.642263 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] osapi_compute_listen = 0.0.0.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.642790 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] osapi_compute_listen_port = 8774 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.643320 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] osapi_compute_unique_server_name_scope = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.643847 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] osapi_compute_workers = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.644435 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] password_length = 12 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.644983 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] periodic_enable = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.645500 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] periodic_fuzzy_delay = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.646026 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] pointer_model = usbtablet {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.646598 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] preallocate_images = none {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.647137 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] publish_errors = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.647615 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] pybasedir = /opt/stack/nova {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.648156 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ram_allocation_ratio = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.648706 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] rate_limit_burst = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.649250 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] rate_limit_except_level = CRITICAL {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.649786 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] rate_limit_interval = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.650334 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] reboot_timeout = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.650856 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] reclaim_instance_interval = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.651425 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] record = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.651973 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] report_interval = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.652598 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] rescue_timeout = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.653133 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] reserved_host_cpus = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.653710 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] reserved_host_disk_mb = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.654251 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] reserved_host_memory_mb = 512 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.654810 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] reserved_huge_pages = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.655333 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] resize_confirm_window = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.655858 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] resize_fs_using_block_device = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.656757 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] resume_guests_state_on_host_boot = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.657335 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.657892 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] rpc_response_timeout = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.658719 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] run_external_periodic_tasks = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.659288 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] running_deleted_instance_action = reap {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.659812 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.660597 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] running_deleted_instance_timeout = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.661121 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler_instance_sync_interval = 120 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.661772 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_down_time = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.666233 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] servicegroup_driver = db {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.666947 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] shelved_offload_time = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.667080 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_db.sqlalchemy.engines [None req-b49d396e-98ae-45cb-90e1-bd84f5016c47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:57:06.667621 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] shelved_poll_interval = 3600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.669378 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] shutdown_timeout = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.670236 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] source_is_ipv6 = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.670778 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ssl_only = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.671305 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] state_path = /opt/stack/data/nova {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.671846 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] sync_power_state_interval = 600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.672411 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] sync_power_state_pool_size = 1000 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.672966 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] syslog_log_facility = LOG_USER {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.673639 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] tempdir = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.679691 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] timeout_nbd = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.679691 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] transport_url = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.679691 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] update_resources_interval = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.679691 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] use_cow_images = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.679691 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] use_eventlog = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.679691 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] use_journal = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.679691 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] use_json = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.680255 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] use_rootwrap_daemon = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.680255 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] use_stderr = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.680255 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] use_syslog = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.680255 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vcpu_pin_set = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.680255 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vif_plugging_is_fatal = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.680255 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vif_plugging_timeout = 300 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.680255 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] virt_mkfs = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.681003 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] volume_usage_poll_interval = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.681559 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] watch_log_file = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.682155 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] web = /usr/share/spice-html5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:57:06.682886 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.683490 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.684223 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.684792 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.685520 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.686175 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.686739 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.687394 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.auth_strategy = keystone {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.687970 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.compute_link_prefix = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.688594 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.689194 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.dhcp_domain = novalocal {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.689754 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.enable_instance_password = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.690315 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.glance_link_prefix = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.690927 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.691514 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.692080 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.instance_list_per_project_cells = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.692687 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.list_records_by_skipping_down_cells = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.693260 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.local_metadata_per_cell = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.693852 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.max_limit = 1000 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.694417 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.metadata_cache_expiration = 15 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.694993 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.neutron_default_tenant_id = default {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.695595 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.use_forwarded_for = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.696157 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.use_neutron_default_nets = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.697006 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.697604 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.698853 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.700023 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.700683 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.vendordata_dynamic_targets = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.701284 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.vendordata_jsonfile_path = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.702001 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.702694 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.backend = dogpile.cache.memcached {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708391 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.backend_argument = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708391 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.config_prefix = cache.oslo {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708391 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.dead_timeout = 60.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708391 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.debug_cache_backend = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708391 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.enable_retry_client = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708391 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.enable_socket_keepalive = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708391 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.enabled = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708864 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.expiration_time = 600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708864 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708864 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.hashclient_retry_delay = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708864 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.memcache_dead_retry = 300 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708864 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.708864 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.709583 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.memcache_pool_maxsize = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.710189 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.710778 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.711362 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.memcache_socket_timeout = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.711932 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.proxies = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.712622 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.retry_attempts = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.713186 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.retry_delay = 0.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.713749 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.socket_keepalive_count = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.714331 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.socket_keepalive_idle = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.714910 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.socket_keepalive_interval = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.715998 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.tls_allowed_ciphers = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.716573 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.tls_cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.717131 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.tls_certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.717701 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.tls_enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.718334 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cache.tls_keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.718963 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.auth_section = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.719614 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.auth_type = password {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.720201 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.720938 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.catalog_info = volumev3::publicURL {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.721508 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.722063 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.722781 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.cross_az_attach = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.723346 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.debug = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.723904 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.endpoint_template = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.724531 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.http_retries = 3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.725088 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.725687 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.726313 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.os_region_name = RegionOne {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.726929 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.727477 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cinder.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.728077 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.728645 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.cpu_dedicated_set = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.729240 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.cpu_shared_set = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.729816 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.image_type_exclude_list = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.730371 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.731020 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.731582 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.732144 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.732739 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.733348 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.resource_provider_association_refresh = 300 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.733927 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] compute.shutdown_retry_interval = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.734520 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] conductor.workers = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.735153 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] console.allowed_origins = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.735716 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] console.ssl_ciphers = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.736325 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] console.ssl_minimum_version = default {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.736903 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] consoleauth.token_ttl = 600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.737536 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.738096 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.738653 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.739206 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.connect_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.739766 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.connect_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.740360 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.endpoint_override = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.740928 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.741530 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.742152 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.max_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.742703 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.min_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.743258 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.region_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.743825 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.service_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.744410 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.service_type = accelerator {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.744706 ncdv-master-1 nova-conductor[128731]: DEBUG nova.service [None req-08df15e2-9ac1-4f58-bed7-a50875aa7945 None None] Creating RPC server for service conductor {{(pid=128731) start /opt/stack/nova/nova/service.py:182}} Apr 16 20:57:06.744988 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.745432 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.status_code_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.745821 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.status_code_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.746228 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.746695 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.747104 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] cyborg.version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.747568 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.backend = sqlalchemy {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.747999 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.connection = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.748422 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.connection_debug = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.748868 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.connection_parameters = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.749400 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.connection_recycle_time = 3600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.749943 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.connection_trace = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754252 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.db_inc_retry_interval = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754252 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.db_max_retries = 20 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754252 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.db_max_retry_interval = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754252 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.db_retry_interval = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754252 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.max_overflow = 50 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754252 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.max_pool_size = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754252 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.max_retries = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754723 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.mysql_enable_ndb = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754723 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754723 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.pool_timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754723 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.retry_interval = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.754961 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.slave_connection = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.755159 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.sqlite_synchronous = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.755550 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] database.use_db_reconnect = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.755962 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.backend = sqlalchemy {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.756406 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.connection = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.756798 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.connection_debug = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.757237 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.connection_parameters = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.757625 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.connection_recycle_time = 3600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.758013 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.connection_trace = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.758392 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.db_inc_retry_interval = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.758779 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.db_max_retries = 20 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.759244 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.db_max_retry_interval = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.759637 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.db_retry_interval = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.760025 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.max_overflow = 50 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.760448 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.max_pool_size = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.760844 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.max_retries = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.761275 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.mysql_enable_ndb = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.761672 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.762587 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.pool_timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.762983 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.retry_interval = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.763391 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.slave_connection = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.763778 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] api_database.sqlite_synchronous = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.764248 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] devices.enabled_mdev_types = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.764678 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.765109 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ephemeral_storage_encryption.enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.765495 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.765914 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.api_servers = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.766302 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.766680 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.767058 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.767465 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.connect_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.767852 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.connect_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.768275 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.debug = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.768716 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.default_trusted_certificate_ids = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.769152 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.enable_certificate_validation = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.769540 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.enable_rbd_download = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.769911 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.endpoint_override = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.770291 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.770666 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.771034 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.max_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.771400 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.min_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.771788 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.num_retries = 3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.772211 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.rbd_ceph_conf = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.772575 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.rbd_connect_timeout = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.772963 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.rbd_pool = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.773399 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.rbd_user = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.773777 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.region_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.774146 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.service_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.774566 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.service_type = image {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.774924 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.775294 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.status_code_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.775688 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.status_code_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.776056 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.776500 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.776882 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.verify_glance_signatures = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.777267 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] glance.version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.778190 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] guestfs.debug = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.778612 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.config_drive_cdrom = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.779170 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.config_drive_inject_password = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.779739 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.780315 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.780887 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.enable_remotefx = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.781587 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.instances_path_share = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.782187 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.iscsi_initiator_list = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.782739 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.limit_cpu_features = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.783310 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.783860 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.784475 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.785043 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.785711 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.786273 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.use_multipath_io = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.786850 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.787418 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.787984 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.vswitch_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.788561 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.789144 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] mks.enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.790467 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.791071 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] image_cache.manager_interval = 2400 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.791647 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] image_cache.precache_concurrency = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.792301 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] image_cache.remove_unused_base_images = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.792870 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.793474 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.794051 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] image_cache.subdirectory_name = _base {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.794639 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.api_max_retries = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.795213 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.api_retry_interval = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.795771 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.auth_section = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.796377 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.auth_type = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.796964 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.797597 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.798183 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.798835 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.connect_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.805653 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.connect_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.805763 ncdv-master-1 nova-conductor[128732]: DEBUG nova.service [None req-b49d396e-98ae-45cb-90e1-bd84f5016c47 None None] Creating RPC server for service conductor {{(pid=128732) start /opt/stack/nova/nova/service.py:182}} Apr 16 20:57:06.805855 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.endpoint_override = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.805855 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.805855 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.805855 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.max_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.805855 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.min_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.805855 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.partition_key = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.805855 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.peer_list = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.806262 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.region_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.806262 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.serial_console_state_timeout = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.806262 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.service_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.806262 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.service_type = baremetal {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.806262 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.806262 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.status_code_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.806262 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.status_code_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.806658 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.807833 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.808460 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ironic.version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.809142 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.809834 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] key_manager.fixed_key = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.810545 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.811150 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.barbican_api_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.811751 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.barbican_endpoint = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.812438 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.barbican_endpoint_type = public {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.813156 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.barbican_region_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.813791 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.814392 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.815021 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.815632 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.816244 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.816806 ncdv-master-1 nova-conductor[128731]: DEBUG nova.service [None req-08df15e2-9ac1-4f58-bed7-a50875aa7945 None None] Join ServiceGroup membership for this service conductor {{(pid=128731) start /opt/stack/nova/nova/service.py:199}} Apr 16 20:57:06.817109 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.number_of_retries = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.817267 ncdv-master-1 nova-conductor[128731]: DEBUG nova.servicegroup.drivers.db [None req-08df15e2-9ac1-4f58-bed7-a50875aa7945 None None] DB_Driver: join new ServiceGroup member ncdv-master-1 to the conductor group, service = {{(pid=128731) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Apr 16 20:57:06.817860 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.retry_delay = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.818457 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.send_service_user_token = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.819042 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.819633 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.820273 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.verify_ssl = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.820868 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican.verify_ssl_path = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.821493 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.auth_section = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.822125 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.auth_type = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.822703 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.823328 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.823921 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.825061 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.825641 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.826253 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.826847 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] barbican_service_user.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.827469 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.approle_role_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.828045 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.approle_secret_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.828659 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.829280 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.829884 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.830496 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.831085 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.831703 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.kv_mountpoint = secret {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.832359 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.kv_version = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.832938 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.namespace = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.833545 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.root_token_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.834172 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.834754 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.ssl_ca_crt_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.835329 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.835912 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.use_ssl = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.836616 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.837280 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.837875 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.838466 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.839074 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.connect_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.839650 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.connect_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.840415 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.endpoint_override = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.841025 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.841603 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.842238 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.max_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.842816 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.min_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.843415 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.region_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.844005 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.service_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.844637 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.service_type = identity {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.845224 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.845808 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.status_code_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.846399 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.status_code_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.846523 ncdv-master-1 nova-conductor[128732]: DEBUG nova.service [None req-b49d396e-98ae-45cb-90e1-bd84f5016c47 None None] Join ServiceGroup membership for this service conductor {{(pid=128732) start /opt/stack/nova/nova/service.py:199}} Apr 16 20:57:06.847037 ncdv-master-1 nova-conductor[128732]: DEBUG nova.servicegroup.drivers.db [None req-b49d396e-98ae-45cb-90e1-bd84f5016c47 None None] DB_Driver: join new ServiceGroup member ncdv-master-1 to the conductor group, service = {{(pid=128732) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Apr 16 20:57:06.847330 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.847945 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.848574 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] keystone.version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.849271 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.connection_uri = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.849883 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.cpu_mode = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.850502 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.cpu_model_extra_flags = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.851104 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.cpu_models = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.851728 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.device_detach_attempts = 8 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.852370 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.device_detach_timeout = 20 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.852971 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.disk_cachemodes = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.853567 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.disk_prefix = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.854153 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.enabled_perf_events = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.854740 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.file_backed_memory = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.855323 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.gid_maps = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.856470 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.hw_disk_discard = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.857076 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.hw_machine_type = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.857671 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.images_rbd_ceph_conf = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.858314 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.858926 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.859588 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.images_rbd_glance_store_name = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.860215 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.images_rbd_pool = rbd {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.860837 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.images_type = default {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.861431 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.images_volume_group = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.862015 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.inject_key = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.862609 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.inject_partition = -2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.863191 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.inject_password = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.863816 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.iscsi_iface = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.864429 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.iser_use_multipath = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.865037 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.865636 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.866236 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_downtime = 500 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.866820 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.867433 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.868014 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_inbound_addr = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.868618 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.869222 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.869810 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_scheme = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.870422 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_timeout_action = abort {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.871005 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_tunnelled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.872133 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_uri = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.872923 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.live_migration_with_native_tls = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.873336 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.max_queues = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.873816 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.874240 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.nfs_mount_options = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.874874 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.875379 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.875778 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.num_iser_scan_tries = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.876202 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.876616 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.877058 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.num_pcie_ports = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.877461 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.num_volume_scan_tries = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.877999 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.pmem_namespaces = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.878388 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.quobyte_client_cfg = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.878894 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.879284 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rbd_connect_timeout = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.879673 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.880092 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.880505 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rbd_secret_uuid = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.880987 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rbd_user = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.881389 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.881795 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.882198 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rescue_image_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.882710 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rescue_kernel_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.883092 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rescue_ramdisk_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.883487 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.883889 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.rx_queue_size = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.884320 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.smbfs_mount_options = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.884835 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.885254 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.snapshot_compression = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.885665 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.snapshot_image_format = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.886596 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.887517 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.sparse_logical_volumes = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.888006 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.swtpm_enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.888440 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.swtpm_group = tss {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.888906 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.swtpm_user = tss {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.889315 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.sysinfo_serial = unique {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.889697 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.tx_queue_size = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.890088 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.uid_maps = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.890489 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.use_virtio_for_bridges = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.890935 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.virt_type = kvm {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.891335 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.volume_clear = zero {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.891721 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.volume_clear_size = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.892112 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.volume_use_multipath = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.892611 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.vzstorage_cache_path = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.893014 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.893413 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.vzstorage_mount_group = qemu {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.893803 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.vzstorage_mount_opts = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.894201 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.894680 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.895083 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.vzstorage_mount_user = stack {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.895469 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.895899 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.auth_section = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.896330 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.auth_type = password {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.896712 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.897093 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.897475 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.897900 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.connect_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.898258 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.connect_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.898654 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.default_floating_pool = public {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.899046 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.endpoint_override = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.899438 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.extension_sync_interval = 600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.899846 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.http_retries = 3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.900257 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.900643 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.901021 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.max_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.901422 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.901800 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.min_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.902208 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.ovs_bridge = br-int {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.903248 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.physnets = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.903646 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.region_name = RegionOne {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.904049 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.service_metadata_proxy = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.904438 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.service_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.904862 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.service_type = network {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.905249 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.905648 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.status_code_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.906026 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.status_code_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.906408 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.906827 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.907208 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] neutron.version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.907605 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] notifications.bdms_in_notifications = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.908007 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] notifications.default_level = INFO {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.908442 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] notifications.notification_format = unversioned {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.908835 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] notifications.notify_on_state_change = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.909271 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.909724 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] pci.alias = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.910096 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] pci.passthrough_whitelist = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.910529 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.auth_section = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.910966 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.auth_type = password {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.911397 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.auth_url = http://10.222.0.20/identity {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.911772 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.912153 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.912561 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.912949 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.connect_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.913328 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.connect_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.913729 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.default_domain_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.914126 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.default_domain_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.914511 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.domain_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.914886 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.domain_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.915264 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.endpoint_override = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.915646 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.916024 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.916420 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.max_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.916798 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.min_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.917187 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.password = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.917568 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.project_domain_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.917965 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.project_domain_name = Default {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.918381 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.project_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.918784 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.project_name = service {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.919175 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.region_name = RegionOne {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.919551 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.service_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.919952 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.service_type = placement {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.920367 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.920746 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.status_code_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.921142 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.status_code_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.921520 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.system_scope = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.921901 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.922299 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.trust_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.922675 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.user_domain_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.923064 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.user_domain_name = Default {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.923444 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.user_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.923837 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.username = placement {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.924272 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.924652 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] placement.version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.925080 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] powervm.disk_driver = localdisk {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.925495 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] powervm.proc_units_factor = 0.1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.925910 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] powervm.volume_group_name = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.926298 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.cores = 20 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.926966 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.count_usage_from_placement = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.927364 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.927945 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.injected_file_content_bytes = 10240 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.928530 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.injected_file_path_length = 255 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.929068 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.injected_files = 5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.929622 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.instances = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.930155 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.key_pairs = 100 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.930587 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.metadata_items = 128 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.930980 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.ram = 51200 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.931366 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.recheck_quota = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.931758 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.server_group_members = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.932155 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] quota.server_groups = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.932573 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] rdp.enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.933187 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.933619 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.934542 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.934937 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.image_metadata_prefilter = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.935320 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.935708 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.max_attempts = 3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.936095 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.max_placement_results = 1000 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.936511 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.936895 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.query_placement_for_availability_zone = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.937291 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.937676 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.938075 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] scheduler.workers = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.938506 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.938903 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.939332 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.939725 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.940112 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.940530 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.940918 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.941377 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.941767 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.host_subset_size = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.942149 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.942544 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.942936 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.isolated_hosts = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.943326 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.isolated_images = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.943714 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.944105 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.944509 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.945701 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.945701 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.945701 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.946135 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.946421 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.946834 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.track_instance_changes = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.947238 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.947684 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] metrics.required = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.948068 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] metrics.weight_multiplier = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.948478 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.948870 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] metrics.weight_setting = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.949931 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.949931 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] serial_console.enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.950355 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] serial_console.port_range = 10000:20000 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.950760 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.951152 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.951708 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] serial_console.serialproxy_port = 6083 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.952106 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.auth_section = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.952538 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.auth_type = password {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.952932 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.953317 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.953703 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.954080 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.954462 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.954929 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.send_service_user_token = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.955240 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.955616 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] service_user.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.956033 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] spice.agent_enabled = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.956439 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] spice.enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.957057 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.957493 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.957894 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] spice.html5proxy_port = 6082 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.958314 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] spice.server_listen = 127.0.0.1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.958714 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.959137 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] upgrade_levels.baseapi = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.959542 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] upgrade_levels.cert = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.959936 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] upgrade_levels.compute = auto {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.960349 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] upgrade_levels.conductor = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.960730 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] upgrade_levels.scheduler = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.961138 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.961572 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.961948 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.962323 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.962702 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.963092 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.963473 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.963853 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.964249 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vendordata_dynamic_auth.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.964699 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.api_retry_count = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.965611 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.ca_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.965996 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.cache_prefix = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.966801 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.cluster_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.966801 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.connection_pool_size = 10 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.967150 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.console_delay_seconds = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.967533 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.datastore_regex = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.967906 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.host_ip = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.968306 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.host_password = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.968691 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.host_port = 443 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.969065 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.host_username = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.969444 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.969824 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.integration_bridge = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.970201 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.maximum_objects = 100 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.970576 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.pbm_default_policy = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.970974 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.pbm_enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.971346 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.pbm_wsdl_location = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.971739 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.972117 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.serial_port_proxy_uri = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.972525 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.serial_port_service_uri = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.973251 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.task_poll_interval = 0.5 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.973251 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.use_linked_clone = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.973709 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.vnc_keymap = en-us {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.974076 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.vnc_port = 5900 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.974482 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vmware.vnc_port_total = 10000 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.974939 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.auth_schemes = ['none'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.975328 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.enabled = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.975930 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.976384 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.976783 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.novncproxy_port = 6080 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.977211 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.server_listen = 127.0.0.1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.977611 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.978009 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.vencrypt_ca_certs = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.978388 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.vencrypt_client_cert = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.978768 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] vnc.vencrypt_client_key = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.979582 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.979582 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.979948 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.980359 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.981312 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.disable_rootwrap = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.981696 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.enable_numa_live_migration = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.982082 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.982468 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.982857 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.983269 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.libvirt_disable_apic = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.983653 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.984066 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.984440 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.984868 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.985248 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.985707 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.client_socket_timeout = 900 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.986059 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.default_pool_size = 1000 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.986421 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.keep_alive = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.986810 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.max_header_line = 16384 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.987193 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.secure_proxy_ssl_header = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.987618 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.ssl_ca_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.987969 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.ssl_cert_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.988378 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.ssl_key_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.988770 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.tcp_keepidle = 600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.989179 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.989568 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] zvm.ca_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.989948 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] zvm.cloud_connector_url = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.990439 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.990825 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] zvm.reachable_timeout = 300 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.991265 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.enforce_new_defaults = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.991654 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.enforce_scope = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.992079 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.policy_default_rule = default {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.992541 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.992979 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.policy_file = policy.yaml {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.993422 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.993802 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.994179 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.994573 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.994975 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.995406 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.995819 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.996306 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.connection_string = messaging:// {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.996715 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.enabled = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.997132 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.es_doc_type = notification {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.997523 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.es_scroll_size = 10000 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.997939 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.es_scroll_time = 2m {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.998311 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.filter_error_trace = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.998708 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.hmac_keys = SECRET_KEY {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.999100 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.sentinel_service_name = mymaster {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.999512 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.socket_timeout = 0.1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:06.999892 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] profiler.trace_sqlalchemy = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.000364 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] remote_debug.host = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.000754 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] remote_debug.port = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.001194 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.001584 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.001979 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.002367 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.002766 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.003158 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.003548 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.003956 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.004381 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.004769 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.005177 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.005566 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.005963 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.006414 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.006736 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.007136 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.007518 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.007899 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.008315 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.008702 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.009090 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.009482 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.009870 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.ssl = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.010266 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.010663 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.011134 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.011457 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.011966 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.012376 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.012842 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.013241 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.013680 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.auth_section = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.014062 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.auth_type = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.014435 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.cafile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.014810 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.certfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.015365 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.collect_timing = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.015704 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.connect_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.015933 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.connect_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.016334 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.endpoint_id = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.016714 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.endpoint_override = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.017096 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.insecure = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.017468 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.keyfile = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.017843 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.max_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.018214 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.min_version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.018653 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.region_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.018976 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.service_name = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.019371 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.service_type = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.019817 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.split_loggers = False {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.020205 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.status_code_retries = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.020587 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.status_code_retry_delay = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.020963 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.timeout = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.021340 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.valid_interfaces = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.023011 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_limit.version = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.023011 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_reports.file_event_handler = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.023011 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.023011 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] oslo_reports.log_dir = None {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:57:07.023597 ncdv-master-1 nova-conductor[127856]: DEBUG oslo_service.service [None req-6c0185de-3073-47d7-be57-f68f08c9f2c1 None None] ******************************************************************************** {{(pid=127856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 16 21:07:10.909880 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_db.sqlalchemy.engines [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Parent process 127856 forked (128731) with an open database connection, which is being discarded and recreated. {{(pid=128731) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Apr 16 21:07:12.101257 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Took 1.15 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:07:12.166397 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.170846 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:12.180423 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_db.sqlalchemy.engines [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:07:12.655095 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.656888 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:12.658164 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.658742 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:12.686318 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_db.sqlalchemy.engines [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:07:12.733973 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Getting quotas for project 998f0203a6c741839bde8be2da375d4f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:12.741497 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Getting quotas for user 82856a20b3764d17b5c9c1bebdd46c68 and project 998f0203a6c741839bde8be2da375d4f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:12.770975 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:07:12.772388 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.772941 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:12.888802 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:07:12.893387 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.894145 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.236085 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:13.236695 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.237069 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Acquired lock "compute-rpcapi-router" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:07:13.238231 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0cf911ce-4f86-4100-92c3-14cc72bec0fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:13.238779 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0cf911ce-4f86-4100-92c3-14cc72bec0fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.239492 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0cf911ce-4f86-4100-92c3-14cc72bec0fa None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:13.239888 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0cf911ce-4f86-4100-92c3-14cc72bec0fa None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.250895 ncdv-master-1 nova-conductor[128731]: INFO nova.compute.rpcapi [None req-0cf911ce-4f86-4100-92c3-14cc72bec0fa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 16 21:07:13.251974 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0cf911ce-4f86-4100-92c3-14cc72bec0fa None None] Releasing lock "compute-rpcapi-router" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:07:13.773002 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_db.sqlalchemy.engines [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Parent process 127856 forked (128732) with an open database connection, which is being discarded and recreated. {{(pid=128732) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Apr 16 21:07:14.876423 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Took 1.09 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:07:14.968628 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:14.975000 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:15.003741 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_db.sqlalchemy.engines [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:07:15.358688 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:15.360518 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:15.361806 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:15.362297 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:15.384920 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_db.sqlalchemy.engines [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:07:15.449836 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Getting quotas for project 99672927446f4ecfb3b1e170073b6797. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:15.457081 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Getting quotas for user e4c25e69f3ab461a99dac0a9a9ada83c and project 99672927446f4ecfb3b1e170073b6797. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:15.476310 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:07:15.480257 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:15.482591 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:15.574590 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:07:15.581685 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:15.581685 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:16.136036 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:16.136647 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:16.137572 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Acquired lock "compute-rpcapi-router" {{(pid=128732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:07:16.138881 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4fe32267-8d61-437e-b8e0-0e720dc4936f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:16.139525 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4fe32267-8d61-437e-b8e0-0e720dc4936f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:16.140713 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4fe32267-8d61-437e-b8e0-0e720dc4936f None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:16.141344 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4fe32267-8d61-437e-b8e0-0e720dc4936f None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:16.154247 ncdv-master-1 nova-conductor[128732]: INFO nova.compute.rpcapi [None req-4fe32267-8d61-437e-b8e0-0e720dc4936f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 16 21:07:16.155370 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4fe32267-8d61-437e-b8e0-0e720dc4936f None None] Releasing lock "compute-rpcapi-router" {{(pid=128732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:07:40.473402 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:07:40.515731 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:40.516066 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:40.879639 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:40.880100 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:40.880870 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:40.881266 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:40.897536 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for project d6395bf8972949f8837289679b58d151. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:40.902312 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for user aa7da58ce23242bd947bbd7387b80b8d and project d6395bf8972949f8837289679b58d151. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:40.923735 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:07:40.924726 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:40.925138 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:40.994809 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:07:40.996709 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:40.997364 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.277322 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.277784 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.489034 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:07:55.513639 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.514126 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.641200 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.641959 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.642863 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.643254 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.659558 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Getting quotas for project 998f0203a6c741839bde8be2da375d4f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:55.664639 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Getting quotas for user 82856a20b3764d17b5c9c1bebdd46c68 and project 998f0203a6c741839bde8be2da375d4f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:55.676299 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:07:55.677256 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.677649 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.812979 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:07:55.814319 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.814846 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.140227 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.140770 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:04.767131 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:04.800261 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:04.800574 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.166042 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.166472 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.167177 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.167591 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.183085 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Getting quotas for project 487e280d7b014a7196cd1e4e9165cc7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:05.188372 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Getting quotas for user 160e460966db4a7e8b697e26de50d0ff and project 487e280d7b014a7196cd1e4e9165cc7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:05.200440 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:05.201522 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.201926 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.277655 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:05.278903 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.281477 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.509104 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:05.530898 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.531307 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.550931 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.551359 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.936483 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.936886 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.937795 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.938219 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.957935 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:05.958140 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for user 53d5464685cc40d9a1d891c6ae39a80f and project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:05.969779 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:05.970909 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.971318 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:06.126958 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:06.130124 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:06.130124 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:06.432012 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:06.432572 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:23.418820 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:23.438671 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:23.439089 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:23.566632 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:23.567052 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:23.568152 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:23.568612 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:23.586356 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Getting quotas for project 487e280d7b014a7196cd1e4e9165cc7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:23.591408 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Getting quotas for user 160e460966db4a7e8b697e26de50d0ff and project 487e280d7b014a7196cd1e4e9165cc7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:23.606861 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:23.607829 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:23.608278 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:23.743836 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:23.745613 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:23.746156 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.048768 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.049503 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.276325 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:08:25.276941 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.277236 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:26.581770 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Created allocations for migration 5df8f1e3-400a-4015-9aec-1ac8728f92a1 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:08:27.207969 ncdv-master-1 nova-conductor[128732]: DEBUG nova.scheduler.utils [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Instance allocations successfully created on destination node c419ac35-cde4-4dc1-9de3-3a64a500ee12: {'allocations': {'c419ac35-cde4-4dc1-9de3-3a64a500ee12': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=128732) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Apr 16 21:08:27.211941 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'resources' on Instance uuid d06de5cf-0b6e-4546-b316-545265d6af2a {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:27.218992 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'pci_requests' on Instance uuid d06de5cf-0b6e-4546-b316-545265d6af2a {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:28.699679 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.live_migrate [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Start binding ports on destination host: nch1-master-1 {{(pid=128732) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:08:30.917532 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:30.937499 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:30.937920 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:31.183535 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:31.184017 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:31.184918 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:31.185428 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:31.201335 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Getting quotas for project 676a0384d9444d9d8e42073806728c43. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:31.206128 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Getting quotas for user 01db629e453f41ff8debfefd155aa14c and project 676a0384d9444d9d8e42073806728c43. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:31.218390 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:31.219414 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:31.219885 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:31.326211 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:31.327474 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:31.327882 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:31.911023 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:31.911438 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:39.956533 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:39.997712 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.001527 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.279330 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.281928 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.283731 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.285722 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.331279 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:40.345087 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for user 547d9f3aa3a54867971074b795d83b81 and project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:40.375699 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:40.379518 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.381661 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.473311 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:40.475007 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.475613 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.962575 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.965941 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.420025 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:50.454052 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.456312 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.686600 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.687014 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.687759 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.688161 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.706554 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Getting quotas for project 1924a4ceffaf45d0bf2bd76ebb421bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:50.711775 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Getting quotas for user eae06aafd64d46deacb8ae1791676d75 and project 1924a4ceffaf45d0bf2bd76ebb421bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:50.724698 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:50.725879 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.726320 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.872968 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:50.874302 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.874653 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.992086 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:51.013827 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.014333 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.173321 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.174160 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.178844 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.179438 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.199936 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:51.204389 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for user 53d5464685cc40d9a1d891c6ae39a80f and project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:51.215792 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:51.216866 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.217316 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.291036 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.291876 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.318036 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:51.321286 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.321286 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.589047 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.589576 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.852867 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:57.905025 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.905896 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.224354 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.224767 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.225494 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.226209 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.247646 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for project ba3fef3234544544870ea9ee02d5b344. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:58.255944 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for user 7fa9708327d54bbea48ed890d0506ea2 and project ba3fef3234544544870ea9ee02d5b344. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:58.266076 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:58.267365 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.267840 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.336336 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:58.340721 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.340721 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.604862 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:08:58.625127 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.625534 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.752163 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.754520 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.773109 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.773518 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.774379 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.774620 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.796759 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for project ba3fef3234544544870ea9ee02d5b344. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:58.802059 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for user 7fa9708327d54bbea48ed890d0506ea2 and project ba3fef3234544544870ea9ee02d5b344. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:58.813543 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:08:58.814613 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.815399 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.903406 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:08:58.904629 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.905040 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:59.144218 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:08:59.144218 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:59.144822 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:59.167707 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:59.168127 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:00.169901 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Created allocations for migration a565d925-ab6c-473b-803e-36e2c73ea718 on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:09:00.554393 ncdv-master-1 nova-conductor[128731]: DEBUG nova.scheduler.utils [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Instance allocations successfully created on destination node 318e6e80-3ef5-4e19-b0e2-e8df13c8518c: {'allocations': {'318e6e80-3ef5-4e19-b0e2-e8df13c8518c': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=128731) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Apr 16 21:09:00.555688 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'resources' on Instance uuid e641f7ec-0d41-4439-bc77-7158fb9d346e {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:00.569297 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'pci_requests' on Instance uuid e641f7ec-0d41-4439-bc77-7158fb9d346e {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:03.821415 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.live_migrate [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Start binding ports on destination host: nch2-master-1 {{(pid=128731) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:09:06.263913 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:06.304868 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.308661 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.543257 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.543676 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.544574 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.544972 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.562080 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:06.567586 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:06.588363 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:06.589698 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.590464 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.675337 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:06.683263 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.684273 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.940411 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.943796 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.702378 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:08.749764 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.750580 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.896732 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.908862 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.917273 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.917911 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.971503 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for project d6395bf8972949f8837289679b58d151. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:08.984495 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for user aa7da58ce23242bd947bbd7387b80b8d and project d6395bf8972949f8837289679b58d151. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:09.018760 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:09.019765 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.020210 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.117782 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:09.120958 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.121724 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.260881 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.261306 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.244594 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.247079 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:14.401776 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:09:14.402368 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:14.407062 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:15.349619 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Created allocations for migration c96cfe0e-471b-41b2-87ad-bfeb99154c44 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:09:15.607072 ncdv-master-1 nova-conductor[128732]: DEBUG nova.scheduler.utils [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Instance allocations successfully created on destination node c419ac35-cde4-4dc1-9de3-3a64a500ee12: {'allocations': {'c419ac35-cde4-4dc1-9de3-3a64a500ee12': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=128732) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Apr 16 21:09:15.607677 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'resources' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:15.613784 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'pci_requests' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:16.193385 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:16.231163 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:16.232085 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:16.518015 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:16.518423 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:16.522156 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:16.523729 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:16.562523 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Getting quotas for project 1924a4ceffaf45d0bf2bd76ebb421bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:16.568283 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Getting quotas for user eae06aafd64d46deacb8ae1791676d75 and project 1924a4ceffaf45d0bf2bd76ebb421bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:16.610626 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:16.611748 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:16.612686 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:16.715795 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.live_migrate [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Start binding ports on destination host: nch1-master-1 {{(pid=128732) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:09:16.770756 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:16.772703 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:16.773113 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.181115 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.181907 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.971310 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:18.004054 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.009368 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.342230 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.342884 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.343788 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.344217 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.359657 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Getting quotas for project 3c60195eda214c42831714a690e64ed7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:18.365437 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Getting quotas for user 5c3256e24aea41618454e831a0c2a7b0 and project 3c60195eda214c42831714a690e64ed7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:18.376781 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:18.383562 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.383562 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.476452 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:18.478216 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.478973 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.851171 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.851587 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.248028 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:19.285329 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.288189 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.519699 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.520251 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.521192 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.521809 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.546158 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for project ba3fef3234544544870ea9ee02d5b344. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:19.546158 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for user 7fa9708327d54bbea48ed890d0506ea2 and project ba3fef3234544544870ea9ee02d5b344. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:19.556703 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:19.557898 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.558315 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.639302 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:19.641730 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.644706 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.977170 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.982056 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.445264 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:28.475886 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.476370 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.640685 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.640685 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.640685 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.641111 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.656424 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:28.661143 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for user 547d9f3aa3a54867971074b795d83b81 and project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:28.671948 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:28.672925 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.673330 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.786467 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:28.788416 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.788930 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.179965 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.181464 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.077012 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.077721 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.896408 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Took 0.76 seconds to select destinations for 2 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:32.943741 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.944818 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.125125 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.126276 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.328091 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.328581 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.329252 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.331396 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.360563 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:33.369831 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:33.383314 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:33.384346 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.384974 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.453766 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:33.455331 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.455754 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.757836 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.758670 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.782019 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:33.783530 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance_group [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'hosts' on InstanceGroup uuid 4627cf89-35ca-4dbd-84b8-c29fcd53e795 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:356}} Apr 16 21:09:33.799582 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.800714 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.873950 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:33.878237 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.878237 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.313958 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.314540 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:39.648864 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:39.682427 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:39.683197 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.036986 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.037700 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.038623 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.039183 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.070511 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:40.080401 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for user 0dbf714013674b60b34b2d775a15e722 and project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:40.099046 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:40.100812 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.101592 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.194456 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:40.196606 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.197260 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.930726 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.934515 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.572203 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:41.615418 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.615873 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.834709 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.835414 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.836351 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.836893 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.873296 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:41.881397 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for user 0dbf714013674b60b34b2d775a15e722 and project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:41.906475 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:41.907585 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.908907 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.047105 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:42.048678 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.049243 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.456931 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.457394 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.730951 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Took 0.98 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:43.765082 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.767274 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.885980 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.886609 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.887628 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.888200 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.934392 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:43.940052 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for user 0dbf714013674b60b34b2d775a15e722 and project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:43.956072 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:43.956234 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.957913 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.074176 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:44.075686 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.076286 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.431549 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.432209 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.932909 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:44.956743 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.957903 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.139013 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.140758 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.145992 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.147200 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.179535 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:45.189340 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for user 53d5464685cc40d9a1d891c6ae39a80f and project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:45.203753 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:45.205090 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.205722 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.301616 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:45.301616 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.301616 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.643195 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.644104 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:50.172362 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:09:50.173514 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:50.175268 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.011421 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Created allocations for migration b39c88f5-f2b8-482e-b1b1-12af229a092e on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:09:51.268756 ncdv-master-1 nova-conductor[128732]: DEBUG nova.scheduler.utils [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Instance allocations successfully created on destination node c419ac35-cde4-4dc1-9de3-3a64a500ee12: {'allocations': {'c419ac35-cde4-4dc1-9de3-3a64a500ee12': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=128732) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Apr 16 21:09:51.270399 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'resources' on Instance uuid bc3b9549-fb07-458b-84bf-3f1d36449e6e {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:51.277146 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'pci_requests' on Instance uuid bc3b9549-fb07-458b-84bf-3f1d36449e6e {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:52.021962 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:09:52.042871 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.043286 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.282709 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.283124 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.283877 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.284318 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.300482 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Getting quotas for project d2a21b6df375491fb09fc22109fb4a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:52.305103 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Getting quotas for user 2db9403ce44e460a8165587ae22f0ad2 and project d2a21b6df375491fb09fc22109fb4a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:52.317585 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:09:52.318543 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.318998 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.416757 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:09:52.418137 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.418745 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.729206 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.730099 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:53.167742 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:09:53.168298 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:53.170291 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:53.271020 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.live_migrate [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Start binding ports on destination host: nch1-master-1 {{(pid=128732) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:09:53.350016 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] No migration record for the rebuild/evacuate request. {{(pid=128732) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:10:02.987097 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.988138 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.657678 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Took 0.65 seconds to select destinations for 2 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:10:03.707861 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.707861 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.867287 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.867891 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.080860 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.082367 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.083336 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.083953 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.107671 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:04.113875 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:04.143962 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:10:04.143962 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.143962 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.242809 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:10:04.244153 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.245299 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.496105 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.496572 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.507240 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:10:04.508324 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance_group [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'hosts' on InstanceGroup uuid f04e9963-900e-472a-990e-34003d968b06 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:356}} Apr 16 21:10:04.517733 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.518481 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.581966 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:10:04.583241 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.583665 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.875271 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.875694 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.395133 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:10:14.435866 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.437010 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.747065 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.747681 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.748595 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.749142 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.767780 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:14.773613 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for user 547d9f3aa3a54867971074b795d83b81 and project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:14.787448 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:10:14.788635 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.789358 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.893844 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:10:14.895114 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.895525 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.184773 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.185278 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.978439 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:10:18.979017 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.986683 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:19.104734 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] No migration record for the rebuild/evacuate request. {{(pid=128731) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:10:32.643440 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:10:32.644193 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:32.655089 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:33.340615 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:10:33.377120 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:33.378236 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:33.685894 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:33.686336 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:33.690621 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:33.695010 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:33.741125 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:33.753128 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:33.764964 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:10:33.766197 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:33.769838 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:33.875284 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:10:33.880705 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:33.881842 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:34.342226 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Created allocations for migration a61288cc-3900-430a-9c72-014faa1047f8 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:10:34.845514 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:34.847408 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:34.921218 ncdv-master-1 nova-conductor[128731]: DEBUG nova.scheduler.utils [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Instance allocations successfully created on destination node c419ac35-cde4-4dc1-9de3-3a64a500ee12: {'allocations': {'c419ac35-cde4-4dc1-9de3-3a64a500ee12': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=128731) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Apr 16 21:10:34.921757 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'resources' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:10:34.933806 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'pci_requests' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:10:35.712148 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.live_migrate [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Start binding ports on destination host: nch1-master-1 {{(pid=128731) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:10:54.573300 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:10:54.574047 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:54.574489 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.344651 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Created allocations for migration 7240c7aa-244a-4a9a-ac31-e535562929a3 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:10:55.675511 ncdv-master-1 nova-conductor[128732]: DEBUG nova.scheduler.utils [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Instance allocations successfully created on destination node c419ac35-cde4-4dc1-9de3-3a64a500ee12: {'allocations': {'c419ac35-cde4-4dc1-9de3-3a64a500ee12': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=128732) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Apr 16 21:10:55.676776 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'resources' on Instance uuid d971969c-aa4b-4761-a632-23f88b833ec4 {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:10:55.685817 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'pci_requests' on Instance uuid d971969c-aa4b-4761-a632-23f88b833ec4 {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:10:56.282718 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.live_migrate [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Start binding ports on destination host: nch1-master-1 {{(pid=128732) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:10:58.042070 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:10:58.062959 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.063369 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.213320 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.214125 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.215055 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.215542 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.244290 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:58.249915 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:58.262160 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:10:58.263469 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.264101 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.375718 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:10:58.378187 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.378808 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.725663 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.726080 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.186344 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:11:05.207609 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.208303 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.605441 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.608865 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.608865 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.608865 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.623467 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Getting quotas for project 2dc15580ef8a449ca359a9d5b799e24d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:05.629398 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Getting quotas for user 453306648f4e4da58ee344c3a51f8110 and project 2dc15580ef8a449ca359a9d5b799e24d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:05.641162 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:11:05.649040 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.649040 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.761642 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ff4c0fd-ec61-491f-a0df-5f4c1c8e5bca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:11:05.762918 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.763335 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.997477 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.998352 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:21.977497 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:11:22.018754 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.019196 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.194909 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.195932 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.197158 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.197819 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.217632 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:22.225170 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:22.240428 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:11:22.241426 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.241884 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.324263 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:11:22.325573 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.325991 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.583761 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.584637 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.036686 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Took 1.48 seconds to select destinations for 3 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:11:47.062128 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.062630 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.401532 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.402291 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.645315 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.645810 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.865436 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.865936 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.866757 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.867254 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.882754 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Getting quotas for project 2e9cccbcf0e7456ab8b7c7992372784b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:47.887472 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Getting quotas for user 14b5365affd1481db288841b9ffbf5cb and project 2e9cccbcf0e7456ab8b7c7992372784b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:47.899108 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:11:47.900075 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.900524 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.055736 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:11:48.058187 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.058811 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.378039 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.378494 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.404103 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:11:48.405284 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.406722 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.518500 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:11:48.520061 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.520572 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.914357 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.915310 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.991720 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:11:48.991720 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.991720 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:51.371716 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:11:51.377464 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:51.377464 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:52.597297 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:52.598689 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:29.440134 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:12:29.542077 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:29.542765 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:30.043890 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:30.046115 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:30.049833 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:30.067911 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:30.099311 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Getting quotas for project 1bc88cb7a1504053928ac23280b2b6a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:30.104595 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Getting quotas for user 5bb428513dc444a29288a38ca3e49a6f and project 1bc88cb7a1504053928ac23280b2b6a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:30.117523 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:12:30.118888 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:30.119787 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:30.267378 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:12:30.269292 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:30.269939 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:30.591050 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:30.594098 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:40.768333 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:12:40.798194 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:40.800431 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:41.039835 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:41.043619 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:41.044698 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:41.045101 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:41.070819 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for project f95103d3663146e9ba6ffb49a05196b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:41.080435 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for user 3ad32f0114a44a3bac0c966003e312df and project f95103d3663146e9ba6ffb49a05196b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:41.090719 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:12:41.092191 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:41.092888 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:41.157627 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:12:41.159598 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:41.160324 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:41.437221 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:41.438321 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:54.346308 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:12:54.379726 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:54.380513 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:54.692720 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:54.693486 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:54.695609 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:54.696249 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:54.724687 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:54.731807 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:54.743647 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:12:54.744734 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:54.745247 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:54.879768 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:12:54.881387 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:54.881878 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:55.227594 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:55.228302 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.099310 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:12:59.135038 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.135470 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.267825 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.268635 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.284688 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.284688 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.311430 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:59.317242 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for user 53d5464685cc40d9a1d891c6ae39a80f and project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:59.361010 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:12:59.362061 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.362483 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.532520 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] block_device_mapping [BlockDeviceMapping(attachment_id=3d9f0f23-06dc-4657-89d5-91784ea70a72,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='548a92a5-efad-482f-97c9-7684e6c4b453',volume_size=1,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:12:59.534460 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.535147 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.976932 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.976932 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:08.133156 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:13:08.225415 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:08.226984 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:08.537813 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:08.538234 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:08.538986 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:08.539417 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:08.596016 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:08.610947 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for user 547d9f3aa3a54867971074b795d83b81 and project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:08.636059 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:13:08.637893 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:08.638496 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:08.914593 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] block_device_mapping [BlockDeviceMapping(attachment_id=3d7f5078-64d1-4cce-a7ab-3a039dd4ba0a,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e18c96ab-5353-4ef3-b372-c892883f3711',volume_size=1,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:13:08.921876 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:08.922839 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:09.284267 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:09.284884 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:13.402978 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:13:28.353362 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:13:28.354067 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:28.359011 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:29.723756 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Created allocations for migration 3a2d5fbd-a2cb-4134-bb0e-1d85cc448b5f on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:13:30.107684 ncdv-master-1 nova-conductor[128732]: DEBUG nova.scheduler.utils [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Instance allocations successfully created on destination node c419ac35-cde4-4dc1-9de3-3a64a500ee12: {'allocations': {'c419ac35-cde4-4dc1-9de3-3a64a500ee12': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=128732) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Apr 16 21:13:30.108118 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'resources' on Instance uuid d9673504-31ed-4a93-abbd-67a338294f1f {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:30.112604 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'pci_requests' on Instance uuid d9673504-31ed-4a93-abbd-67a338294f1f {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:30.166573 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:13:30.188163 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:30.188606 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:30.442858 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:30.443588 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:30.444437 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:30.444913 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:30.463359 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Getting quotas for project fe50d9e0841749f094948101efdc3d92. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:30.468429 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Getting quotas for user c87e2c1601764f23ac7530b6ad66b3fd and project fe50d9e0841749f094948101efdc3d92. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:30.493752 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:13:30.498078 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:30.498746 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:30.604550 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:13:30.605827 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:30.606246 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:30.889757 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:30.890175 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:31.024353 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.live_migrate [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Start binding ports on destination host: nch1-master-1 {{(pid=128732) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:13:33.916932 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:13:33.950902 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:33.951727 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:34.250624 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.251149 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:34.252069 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.253545 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:34.270730 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for project 840fd4cbe2fd414bb97f14898bf9647d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:34.275798 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for user 1a6ff623974d4156a05a7bd3e3b3ed5e and project 840fd4cbe2fd414bb97f14898bf9647d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:34.291547 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:13:34.293034 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.293552 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:34.351318 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] block_device_mapping [BlockDeviceMapping(attachment_id=d104ab34-695d-493d-84f7-7428eed2c0b7,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1706c0a9-c59e-4441-98fb-6e924e9769cf',volume_size=1,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:13:34.352981 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.353462 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:34.763159 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.763654 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.269825 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Took 1.25 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:13:36.298762 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.299582 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.463043 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:13:36.464415 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.464859 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.582392 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.584054 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.585226 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.585659 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.611265 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Getting quotas for project ce47d3657e50419183b9ee9cee309667. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:36.617311 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Getting quotas for user 2420585eb37e469da0dab780bf553c2d and project ce47d3657e50419183b9ee9cee309667. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:36.629824 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:13:36.631049 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.631614 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.711659 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] block_device_mapping [BlockDeviceMapping(attachment_id=679cdcdf-720b-4d09-84ec-b2597ea1047f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='00e6b7b1-560b-4bbb-b8e6-499709f33b8f',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=3cc0f3d8-17d6-4a17-a390-2c4e2e413956,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='743c3f5e-43a6-4c29-bbca-fd48d7b20968',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=655143f5-7614-4208-9b28-b57596c0ca79,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7aad57cb-6f75-4d84-a883-22ddddb6aad5',volume_size=1,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:13:36.715860 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.716004 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.871403 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.871403 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.081049 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.081049 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.469192 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.469192 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.469807 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Created allocations for migration 39ada2a4-9d46-4128-94c2-beeb323d2e6e on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:13:37.552990 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:13:37.598564 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.599874 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.787795 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.788396 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.789288 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.789879 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.809076 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for project f95103d3663146e9ba6ffb49a05196b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:37.816191 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for user 3ad32f0114a44a3bac0c966003e312df and project f95103d3663146e9ba6ffb49a05196b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:37.835408 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:13:37.838320 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.839102 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.856845 ncdv-master-1 nova-conductor[128732]: DEBUG nova.scheduler.utils [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Instance allocations successfully created on destination node 318e6e80-3ef5-4e19-b0e2-e8df13c8518c: {'allocations': {'318e6e80-3ef5-4e19-b0e2-e8df13c8518c': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=128732) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Apr 16 21:13:37.857324 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'resources' on Instance uuid 39df3a82-5cde-4311-8bec-5ce2d111d59e {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:37.863531 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'pci_requests' on Instance uuid 39df3a82-5cde-4311-8bec-5ce2d111d59e {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:37.928603 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:13:37.932998 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.932998 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:38.164732 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:38.165532 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.140212 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:13:39.499275 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.live_migrate [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Start binding ports on destination host: nch2-master-1 {{(pid=128732) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:14:08.295994 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:14:08.350948 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.351699 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.524476 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.525262 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.526070 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.526626 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.563096 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Getting quotas for project fe50d9e0841749f094948101efdc3d92. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:14:08.568283 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Getting quotas for user c87e2c1601764f23ac7530b6ad66b3fd and project fe50d9e0841749f094948101efdc3d92. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:14:08.581189 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:14:08.582144 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.582736 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.758970 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:14:08.760963 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.764723 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:09.206734 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:09.207407 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.031316 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:14:19.096929 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.097450 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.387299 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.387695 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.392241 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.392873 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.415747 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Getting quotas for project be0fd7025ca44244ae100b2b916ad1d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:14:19.423331 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Getting quotas for user 27b41363947d44c9be2bda9ed14cbcc4 and project be0fd7025ca44244ae100b2b916ad1d8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:14:19.435769 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:14:19.437055 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.437420 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.556794 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:14:19.569636 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.572625 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.880122 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.880825 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.763457 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Took 1.14 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:14:33.807634 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.812683 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.157514 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.158150 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.159094 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.159926 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.185502 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:14:34.193561 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:14:34.208526 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:14:34.209796 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.210218 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.273316 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:14:34.274607 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.275026 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.931563 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.933542 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.086842 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:14:54.087412 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.087777 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.648291 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:14:55.428000 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Created allocations for migration 2ab5a58e-fb03-408b-bc96-a55d4595e3cd on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:14:56.210674 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:15:00.824196 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Took 1.26 seconds to select destinations for 2 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:15:00.871705 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.873256 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.136361 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.137192 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.345364 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.350552 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.350552 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.352283 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.381773 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Getting quotas for project 5ec2ad232d62489aa704075fad5305c2. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:01.393959 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Getting quotas for user b2bab3afb0f945eca1a7bf9f783cf9fc and project 5ec2ad232d62489aa704075fad5305c2. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:01.414588 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 446a5909-7904-4290-9a61-015b0a1f5d40] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:01.415959 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.416540 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.632322 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 446a5909-7904-4290-9a61-015b0a1f5d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:01.636284 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.636284 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.971483 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.972198 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.984933 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:01.986398 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.987086 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.136839 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:02.136839 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.136839 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.547084 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.547512 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.835328 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:15:15.895444 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.895885 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.202281 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.206342 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.206342 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.206342 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.233081 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Getting quotas for project 70c257ac1872478aacd8b8a29b3c3420. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:16.233474 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Getting quotas for user a87f9fd93b204260ae387e6fa1802df3 and project 70c257ac1872478aacd8b8a29b3c3420. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:16.249302 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:16.250784 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.251362 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.398775 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:16.419332 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.419332 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.755489 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.755917 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.930657 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Took 1.33 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:15:18.971223 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.971721 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.296070 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.296489 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.310873 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.311024 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.332590 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for project c63d4ed9df1548b88731e003044c32da. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:19.338603 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for user 6230c967390f4c5f8d3b9580bac4b340 and project c63d4ed9df1548b88731e003044c32da. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:19.349869 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:19.358782 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.359204 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.452970 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:19.460019 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.460019 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.731049 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.731049 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.416778 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:15:25.416778 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.416778 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.526289 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] No migration record for the rebuild/evacuate request. {{(pid=128732) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:15:25.869953 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Took 0.83 seconds to select destinations for 2 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:15:25.898958 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.899423 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.113176 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.113696 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.260226 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.260885 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.262131 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.262774 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.280615 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Getting quotas for project 5ec2ad232d62489aa704075fad5305c2. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:26.288335 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Getting quotas for user b2bab3afb0f945eca1a7bf9f783cf9fc and project 5ec2ad232d62489aa704075fad5305c2. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:26.301444 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:26.303011 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.303617 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.413077 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:26.414385 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.414960 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.731514 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.731938 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.742981 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:26.744691 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.745261 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.877903 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:26.880045 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.880584 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:27.279772 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:27.280569 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.211851 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:15:36.233496 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.233952 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.362255 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.363822 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.365772 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.366693 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.395572 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:36.402859 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:36.420304 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:36.421649 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.422286 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.514536 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:36.514536 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.514536 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.906474 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.907127 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.486252 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:15:38.528366 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.528784 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.702785 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.703208 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.703952 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.704604 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.723088 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:38.738667 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:38.753810 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:38.754917 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.755646 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.859086 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:38.860583 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.861181 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.142261 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.142685 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.170440 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:15:54.180536 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.180536 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.430009 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:15:55.023326 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Created allocations for migration 8409f2a7-0512-4f2d-ad83-f5b089d7a817 on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:15:55.430656 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:15:55.461873 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.463078 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.591172 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"c419ac35-cde4-4dc1-9de3-3a64a500ee12": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c419ac35-cde4-4dc1-9de3-3a64a500ee12"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=c419ac35-cde4-4dc1-9de3-3a64a500ee12,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:15:55.627192 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.627692 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.628468 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.628877 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.651910 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for project f95103d3663146e9ba6ffb49a05196b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:55.657445 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for user 3ad32f0114a44a3bac0c966003e312df and project f95103d3663146e9ba6ffb49a05196b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:55.674683 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:15:55.676467 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.677093 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.788259 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:15:55.791642 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.792394 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:56.128639 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:56.129489 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.014789 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:16:06.015394 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.015749 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.128248 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] No migration record for the rebuild/evacuate request. {{(pid=128731) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:16:08.559430 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:16:08.582568 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.583257 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.853533 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.853958 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.854711 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.855112 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.874943 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for project ff01c614d0ea4275b713b7e872342151. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:08.887911 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for user 929bcf59f4fb4eb7a8b76809cce91e6e and project ff01c614d0ea4275b713b7e872342151. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:08.896482 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:16:08.897472 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.898072 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.998141 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:16:09.000240 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.006555 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.294803 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.295382 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.467697 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:16:09.495979 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.498973 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.699716 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.701251 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.702225 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.703834 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.726951 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for project ff01c614d0ea4275b713b7e872342151. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:09.733533 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for user 929bcf59f4fb4eb7a8b76809cce91e6e and project ff01c614d0ea4275b713b7e872342151. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:09.751219 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:16:09.752730 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.753311 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.831343 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:16:09.832657 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.833068 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.154369 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.156386 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.072483 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:16:13.094133 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.094639 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.278671 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.281297 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.281297 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.281297 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.324728 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for project c63d4ed9df1548b88731e003044c32da. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:13.332607 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for user 6230c967390f4c5f8d3b9580bac4b340 and project c63d4ed9df1548b88731e003044c32da. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:13.376282 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:16:13.377311 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.377862 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.437839 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:16:13.439517 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.440152 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.781987 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.782511 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.821885 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:16:25.842010 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.845868 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.983966 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.984646 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.985574 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.985977 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.001090 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:26.016319 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:26.034158 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:16:26.035926 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.037120 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.146070 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:16:26.147384 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.147805 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.542398 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.543222 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.368155 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:16:35.392501 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.393183 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.646323 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.647023 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.648022 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.648715 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.678188 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:35.691234 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:35.705419 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:16:35.706310 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.706723 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.791771 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:16:35.793371 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.793792 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.238396 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.238822 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.197842 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:16:50.218869 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.219281 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.355481 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.356156 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.356921 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.357315 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.373542 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for project f95103d3663146e9ba6ffb49a05196b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:50.378359 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for user 3ad32f0114a44a3bac0c966003e312df and project f95103d3663146e9ba6ffb49a05196b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:50.391353 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:16:50.391508 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.392058 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.464120 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:16:50.465628 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.467077 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.719365 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:16:50.720340 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.720780 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.735489 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.735907 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.098234 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128732) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:16:51.673354 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Created allocations for migration d7879bae-2321-4029-99d6-bba148bb09fd on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:16:52.077402 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [Selection(allocation_request='{"allocations": {"318e6e80-3ef5-4e19-b0e2-e8df13c8518c": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["318e6e80-3ef5-4e19-b0e2-e8df13c8518c"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=318e6e80-3ef5-4e19-b0e2-e8df13c8518c,limits=SchedulerLimits,nodename='nch2-master-1',service_host='nch2-master-1')] {{(pid=128732) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:16:59.124360 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:16:59.146259 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.146761 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.241188 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.242112 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.242874 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.243305 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.259779 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for project c63d4ed9df1548b88731e003044c32da. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:59.264559 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for user 6230c967390f4c5f8d3b9580bac4b340 and project c63d4ed9df1548b88731e003044c32da. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:59.275943 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:16:59.276991 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.277411 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.339887 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:16:59.341214 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.341624 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.671555 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.673710 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.728488 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:17:26.778088 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.780335 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.070607 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.071041 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.075586 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.075997 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.130612 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Getting quotas for project c79f0fe4726d4abcbdc2672a15f709f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:27.143540 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Getting quotas for user 484bca4e32554ed4af061012f30666ea and project c79f0fe4726d4abcbdc2672a15f709f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:27.170296 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:17:27.171271 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.179389 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.278196 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:17:27.289047 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.289047 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.643673 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.644112 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.700668 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:17:27.721834 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.729199 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.974234 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.974811 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.975709 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.976306 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.993702 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Getting quotas for project c79f0fe4726d4abcbdc2672a15f709f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:27.998703 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Getting quotas for user 484bca4e32554ed4af061012f30666ea and project c79f0fe4726d4abcbdc2672a15f709f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:28.010740 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:17:28.011985 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.012596 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.088832 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:17:28.090800 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.092094 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.412558 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.413074 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.340059 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:17:31.367622 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.367622 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.514409 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.524673 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.525719 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.526519 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.567751 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for project ff01c614d0ea4275b713b7e872342151. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:31.582753 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for user 929bcf59f4fb4eb7a8b76809cce91e6e and project ff01c614d0ea4275b713b7e872342151. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:31.612795 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:17:31.613505 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.619330 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.687096 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:17:31.688413 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.688832 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.073528 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.074330 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.628596 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:17:32.676833 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.677252 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.828941 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.830804 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.833575 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.834059 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.877020 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:32.899295 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:32.916783 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:17:32.919108 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.919711 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.998687 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:17:33.002968 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.006411 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.337173 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.337724 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.009352 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:17:48.035506 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.036065 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.207904 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.208640 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.209457 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.209945 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.230779 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Getting quotas for project 6391ed1060eb48748245ced6bceec92b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:48.235633 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Getting quotas for user af0b023ad5d34809930c8d837c06c247 and project 6391ed1060eb48748245ced6bceec92b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:48.249019 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:17:48.250036 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.250525 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.334075 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:17:48.335674 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.336092 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.632449 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.632897 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.276630 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:17:49.298659 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.299309 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.618150 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.618818 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.619585 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.619991 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.636025 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for project 3bc8f8d1fc734ce182645a464d35ead8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:49.641194 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for user f0f6bbe8241a49c890032fb779c4bc13 and project 3bc8f8d1fc734ce182645a464d35ead8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:49.652893 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:17:49.653846 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.654292 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.745630 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:17:49.747334 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.747766 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:50.009489 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:50.009931 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:54.167177 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:17:54.170375 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:54.170375 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:54.499043 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128732) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:17:55.227288 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Created allocations for migration 46b19c2b-40ef-4eff-8932-4ac345681fa4 on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:17:55.697358 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=128732) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:18:13.414912 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:18:39.159377 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:19:21.539058 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:19:21.559152 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:21.559565 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:21.760949 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:21.761387 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:21.762848 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:21.763391 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:21.784703 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Getting quotas for project c3cbfdc065da4c4b9f599d9cdd99496d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:19:21.789837 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Getting quotas for user 7495514ac1444f17b2b0fe5b8ba534b1 and project c3cbfdc065da4c4b9f599d9cdd99496d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:19:21.802233 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:19:21.803045 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:21.803454 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:21.869088 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:19:21.870452 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:21.870946 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:22.116891 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:22.117388 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.407702 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:19:32.427725 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.432511 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.694884 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.695534 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.696509 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.697698 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.716631 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for project 14f08d6620b54fb597d356afc45617c7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:19:32.723353 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for user aae8536e08dd4bfb88adc698e7a33d3b and project 14f08d6620b54fb597d356afc45617c7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:19:32.736428 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:19:32.737395 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.737804 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.800949 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:19:32.803039 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.803039 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.002788 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.003205 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:47.586025 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:19:47.628183 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:47.628909 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:47.759545 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:47.759956 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:47.760832 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:47.761142 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:47.776691 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:19:47.781866 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:19:47.794387 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:19:47.795532 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:47.796537 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:47.937782 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:19:47.939379 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:47.939944 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:48.203176 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:48.203672 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.988838 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:19:49.992534 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.992953 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:50.088333 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] No migration record for the rebuild/evacuate request. {{(pid=128732) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:20:02.515028 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:20:02.535214 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.535628 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.749305 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.749716 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.750612 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.751150 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.770413 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Getting quotas for project c3457cd454b04246bb4adb154b41bbb2. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:02.776186 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Getting quotas for user 836ed2bfadd94e2a81048a0621067b33 and project c3457cd454b04246bb4adb154b41bbb2. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:02.795116 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:20:02.796362 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.796953 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.880808 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:20:02.882341 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.882858 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:03.105831 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:03.106327 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.687311 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:20:07.708382 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.708653 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.836312 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.836734 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.837479 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.837905 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.853077 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:07.858245 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:07.873803 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:20:07.874757 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.875231 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.932270 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:20:07.932270 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.932715 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.145065 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.146763 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.149368 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:20:31.187016 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.187571 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.395227 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.396448 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.397446 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.398010 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.433087 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Getting quotas for project 1fb0e213bd0d40ee9e832b54607028ab. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:31.446663 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Getting quotas for user 4866b2c7b7d248539783664403807b09 and project 1fb0e213bd0d40ee9e832b54607028ab. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:31.474372 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:20:31.475369 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.475775 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.715397 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:20:31.721299 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.721299 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.135875 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.138211 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.074180 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:20:36.123738 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.128467 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.316249 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.317216 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.318173 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.319568 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.339288 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for project 14f08d6620b54fb597d356afc45617c7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:36.344995 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for user aae8536e08dd4bfb88adc698e7a33d3b and project 14f08d6620b54fb597d356afc45617c7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:36.357882 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:20:36.359802 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.360465 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.497853 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:20:36.504092 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.504092 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.952531 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.952531 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.276202 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:20:58.276776 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.281738 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.395601 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] No migration record for the rebuild/evacuate request. {{(pid=128731) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:20:59.957503 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:21:00.011760 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.016045 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.184900 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.185321 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.186266 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.186885 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.211281 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Getting quotas for project 1fb0e213bd0d40ee9e832b54607028ab. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:00.217460 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Getting quotas for user 4866b2c7b7d248539783664403807b09 and project 1fb0e213bd0d40ee9e832b54607028ab. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:00.232796 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:21:00.235392 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.235899 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.315144 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:21:00.316821 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.317333 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.607295 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.607724 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.288214 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:21:02.327651 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.329351 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.515782 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.516218 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.516958 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.517355 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.534379 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Getting quotas for project c3457cd454b04246bb4adb154b41bbb2. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:02.539739 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Getting quotas for user 836ed2bfadd94e2a81048a0621067b33 and project c3457cd454b04246bb4adb154b41bbb2. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:02.553693 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:21:02.554863 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.555836 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.619085 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:21:02.621123 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.621742 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.905607 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.906049 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:34.919939 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:21:34.973256 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:34.974034 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:35.319099 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:35.319716 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:35.321888 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:35.322481 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:35.345567 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:35.352448 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for user c9cb29db112b421ea4973953523bc249 and project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:35.366897 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:21:35.371343 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:35.372564 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:35.453167 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:21:35.456461 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:35.457106 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:35.785976 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:35.787049 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:43.742524 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:21:43.770038 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:43.770275 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:43.919092 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:43.919522 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:43.924714 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:43.924714 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:43.965005 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for project 14f08d6620b54fb597d356afc45617c7. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:43.977224 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for user aae8536e08dd4bfb88adc698e7a33d3b and project 14f08d6620b54fb597d356afc45617c7. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:43.993284 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:21:43.994483 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:43.995222 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:44.085972 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:21:44.085972 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:44.085972 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:44.351501 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:44.352452 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:18.226030 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:22:18.264697 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:18.265330 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:18.526787 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:18.526787 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:18.526787 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:18.526787 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:18.596132 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Getting quotas for project 138f1e73cc64451395e6c21d31f3615b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:18.612686 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Getting quotas for user a3f82207271649bca28448b01b65d59f and project 138f1e73cc64451395e6c21d31f3615b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:18.648268 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:22:18.650563 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:18.654613 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:18.719503 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:22:18.720984 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:18.721403 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:18.962893 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:18.963506 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:25.779380 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:25.779919 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.498121 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:22:26.522499 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.523509 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.879221 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.879795 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.880433 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.880844 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.897482 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:26.903538 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:26.915626 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:22:26.916689 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.917100 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.999532 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:22:27.001182 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.001638 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.317662 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.318547 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:54.632201 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:22:54.656375 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:54.658301 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:54.942981 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:54.943666 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:54.945372 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:54.946004 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:54.970074 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:54.975700 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:54.986945 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:22:54.987903 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:54.988446 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.046442 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:22:55.047706 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.048116 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.289546 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:22:55.322031 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.322031 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.336093 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.337468 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.641782 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.642205 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.642932 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.643330 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.663961 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Getting quotas for project 86582d8437084e4e95b3078888c21e23. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:55.676031 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Getting quotas for user 30c7e918d195437091a7d73821c0ed39 and project 86582d8437084e4e95b3078888c21e23. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:55.707691 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:22:55.707691 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.708475 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.766768 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:22:55.768529 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.769563 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:56.042737 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:56.043205 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.258831 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Took 1.38 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:22:57.296851 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.297992 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.580358 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.580358 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.590962 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.590962 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.610390 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Getting quotas for project 8548f70297f04c1489783de67671dba2. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:57.616211 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Getting quotas for user aa437260d34444efa2cef4ea34f57a03 and project 8548f70297f04c1489783de67671dba2. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:57.634519 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:22:57.636547 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.637479 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.750673 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] block_device_mapping [BlockDeviceMapping(attachment_id=7320c8b0-1ef5-42ca-8412-3afe507a110b,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0762402c-a0d6-4894-bf49-142a2b216d88',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=d5b52ac2-e5e5-43f2-951b-db37d4267d57,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=9b79335b-d0df-43cf-8de4-2f4ce53c3f8f,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bf759bc-60a0-4375-9c3a-38f91859fd27',volume_size=1,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:22:57.759027 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.760025 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.818614 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.820090 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.894565 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.895862 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:58.212462 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:58.216902 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.271426 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:23:07.325975 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.326739 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.562215 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.564428 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.569593 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.569593 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.596989 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Getting quotas for project 7d72b2bb3a304796bb144bc739ffcb5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:07.604003 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Getting quotas for user cf7ad620035e4c9f97da1a1b445437b1 and project 7d72b2bb3a304796bb144bc739ffcb5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:07.618086 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:23:07.619540 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.620023 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.686109 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:23:07.689857 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.690781 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.973378 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.973941 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.983989 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:23:21.012458 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.012857 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:21.254900 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.255622 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:21.256605 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.257326 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:21.281069 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Getting quotas for project d5096c21fbfe41dd80379e0e3b6fb8d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:21.288077 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Getting quotas for user 0cc8a2da85ec46948b5bc30ed7a363bc and project d5096c21fbfe41dd80379e0e3b6fb8d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:21.300232 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:23:21.302085 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.302705 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:21.379980 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:23:21.388515 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.388955 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:21.647084 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.647509 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.522018 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:23:24.564838 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.565248 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.620829 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:23:24.651875 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.654105 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.761324 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.761741 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.776364 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.776854 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.810667 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:24.822896 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:24.843285 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:23:24.845508 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.846232 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.887099 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.887099 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.887099 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.887099 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.930456 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:24.936347 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:24.938057 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:23:24.939414 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.941075 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.953843 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:23:24.955314 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.955906 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.069798 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:23:25.072625 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.073697 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.213295 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.214016 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.458063 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.460241 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.157762 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:23:38.197333 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.197794 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.353878 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.354299 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.355607 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.356720 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.376011 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Getting quotas for project 7d72b2bb3a304796bb144bc739ffcb5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:38.382232 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Getting quotas for user cf7ad620035e4c9f97da1a1b445437b1 and project 7d72b2bb3a304796bb144bc739ffcb5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:38.395533 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:23:38.396884 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.397464 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.458910 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:23:38.461086 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.466150 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.744133 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.744661 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:39.173772 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:23:39.964881 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:23:39.997196 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:39.997614 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.267849 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.269128 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.270560 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.272513 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.313846 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Getting quotas for project 90232777aaeb43de91ca009adce2f8ae. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:40.330255 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Getting quotas for user 4910a3e985a3489a8e2a86d9213525a7 and project 90232777aaeb43de91ca009adce2f8ae. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:40.346057 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:23:40.347369 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.348002 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.423821 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:23:40.425372 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.426026 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.742722 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.743459 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:03.112435 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:24:03.133206 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] While scheduling instance, the build request was already deleted. {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1600}} Apr 16 21:24:03.696914 ncdv-master-1 nova-conductor[128731]: INFO nova.scheduler.client.report [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Deleted allocations for instance a13152af-d062-4601-810e-ce65dd5479a9 Apr 16 21:24:03.723285 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:03.727811 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:03.728920 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:03.729795 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:03.785883 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:03.794841 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:06.346860 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:24:06.389871 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:06.390787 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:06.573603 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:06.574553 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:06.575825 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:06.577035 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:06.609282 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:06.614796 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:06.637210 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:24:06.638466 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:06.639044 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:06.726663 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:24:06.728116 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:06.728680 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:07.008238 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:07.009007 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:21.363099 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:24:21.402841 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:21.403586 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:21.711244 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:21.712284 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:21.713615 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:21.714643 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:21.821206 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Getting quotas for project d6dcd4e578e9420cb0aaa2dd0e43a280. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:21.828240 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Getting quotas for user 61eb0141ef744beeb2b9e1a6f25958fb and project d6dcd4e578e9420cb0aaa2dd0e43a280. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:21.846482 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:24:21.848032 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:21.849419 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:22.064995 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:24:22.066191 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:22.066607 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:22.350142 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:22.350820 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.028813 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:24:33.068383 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.068805 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.288867 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.289638 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.290582 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.291175 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.308478 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:33.314664 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:33.326373 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:24:33.327420 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.332266 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.584217 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:24:33.585466 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.585879 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.926546 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.926956 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:40.574203 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:24:40.596706 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:40.597231 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:40.798039 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:40.798634 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:40.799492 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:40.800031 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:40.820722 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Getting quotas for project d6dcd4e578e9420cb0aaa2dd0e43a280. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:40.825359 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Getting quotas for user 61eb0141ef744beeb2b9e1a6f25958fb and project d6dcd4e578e9420cb0aaa2dd0e43a280. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:40.837497 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:24:40.841403 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:40.841403 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:40.978640 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:24:40.979965 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:40.980509 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:41.255672 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:41.256364 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:52.581769 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:24:52.600845 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:52.601260 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:52.774269 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:52.780912 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:52.781908 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:52.782313 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:52.797654 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Getting quotas for project b56376483435432291c5c3beeeae3354. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:52.802758 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Getting quotas for user 07270856a1734c7f9ee203d79aba637c and project b56376483435432291c5c3beeeae3354. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:52.813605 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:24:52.814593 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:52.814998 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:52.873008 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:24:52.885234 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:52.885651 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.087456 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.087860 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.431798 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:24:53.977956 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:24:53.998287 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.998706 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.251705 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.254010 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.258500 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.259037 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.285437 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Getting quotas for project 81cb0c10ca81477bb8c44f27102b04fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:54.290239 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Getting quotas for user f674be6ee5974219ac43d11adc2e33a0 and project 81cb0c10ca81477bb8c44f27102b04fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:54.302139 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:24:54.303683 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.304095 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.375931 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:24:54.377293 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.377804 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.682103 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.682749 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:08.720796 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:25:08.742946 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:08.743464 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:08.927606 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:08.928569 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:08.929070 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:08.929473 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:08.945535 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Getting quotas for project 94f6b07b308c4af99aaecfbf00e08590. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:08.950053 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Getting quotas for user 6d933704fe0946419f1644c2f19b2431 and project 94f6b07b308c4af99aaecfbf00e08590. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:08.961139 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:25:08.962086 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:08.968578 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:09.051203 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:25:09.053894 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:09.054588 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:09.357227 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:09.358923 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.639842 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:25:18.640667 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.640802 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.743639 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] No migration record for the rebuild/evacuate request. {{(pid=128732) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:25:19.242949 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:25:19.285816 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.286305 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.485650 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.486064 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.486820 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.487219 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.540535 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:19.548010 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:19.560720 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:25:19.562037 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.562609 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.634879 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:25:19.636222 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.636709 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.988778 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.989806 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.314348 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:25:27.355252 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.355763 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.638268 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.644123 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.645432 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.645858 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.709674 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Getting quotas for project a919bcedab644defad61a065b44d7887. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:27.718761 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Getting quotas for user 33a57bad127d445d9034befd4fcca951 and project a919bcedab644defad61a065b44d7887. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:27.733325 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:25:27.734739 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.735442 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.829743 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:25:27.831230 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.831680 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.871709 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:25:27.923488 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.923963 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.128034 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.130788 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.133449 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.133856 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.169107 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.169518 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.202508 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Getting quotas for project a919bcedab644defad61a065b44d7887. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:28.223497 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Getting quotas for user 33a57bad127d445d9034befd4fcca951 and project a919bcedab644defad61a065b44d7887. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:28.240068 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:25:28.241652 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.242295 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.324109 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:25:28.325842 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.326481 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.842470 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.843227 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.629944 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:25:37.631819 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.632422 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.703673 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] No migration record for the rebuild/evacuate request. {{(pid=128731) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:25:44.179896 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:25:44.198822 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.199316 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.325637 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.325980 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.326728 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.327141 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.342762 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:44.347987 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:44.359325 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:25:44.360308 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.360728 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.443828 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:25:44.445151 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.445568 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.802353 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.802768 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:02.223202 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Took 1.51 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:26:02.245362 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:02.245814 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:02.557405 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:02.558041 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:02.558947 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:02.559811 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:02.585983 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Getting quotas for project a3b868d01dc64436a62165eaba1c8da0. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:02.591584 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Getting quotas for user 8cd0508c29074deb8e68789231ac5da5 and project a3b868d01dc64436a62165eaba1c8da0. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:02.619341 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:26:02.620925 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:02.621520 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:02.688556 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:26:02.690645 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:02.691443 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:02.985366 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:02.985776 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.082773 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:26:10.083342 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.083668 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.199212 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] No migration record for the rebuild/evacuate request. {{(pid=128732) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:26:16.818104 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method unshelve_instance {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:26:16.818591 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.818778 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:17.633381 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Requesting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) during scheduling {{(pid=128731) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:929}} Apr 16 21:26:18.236611 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:26:18.258625 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lazy-loading 'flavor' on Instance uuid daf189e2-7cb4-4dab-94cf-ffdceb314df7 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:32.109713 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Took 1.25 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:26:32.131783 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.135964 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.375308 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.376068 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.377038 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.378174 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.394536 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:32.399599 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:32.418583 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:26:32.418583 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.418583 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.512159 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:26:32.513509 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.513923 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.914921 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.916763 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.848439 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:26:40.871913 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.872638 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.028008 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.028453 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.029200 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.029612 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.059203 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:41.063974 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:41.076582 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:26:41.077721 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.078136 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.142247 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:26:41.144956 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.145612 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.442278 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.442846 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.971117 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:26:41.990698 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.991030 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.092380 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.092792 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.093521 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.093916 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.109333 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:42.114736 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:42.126799 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:26:42.128406 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.128818 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.195694 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:26:42.196993 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.197429 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.590726 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.591139 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.602867 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:26:44.614686 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156] While scheduling instance, the build request was already deleted. {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1600}} Apr 16 21:26:45.014421 ncdv-master-1 nova-conductor[128731]: INFO nova.scheduler.client.report [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Deleted allocations for instance 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 Apr 16 21:26:45.027876 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.028325 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.029073 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.029483 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.047048 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:45.051774 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:45.650845 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:26:45.677311 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.677311 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.812039 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.812486 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.813421 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.813823 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.831383 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:45.836140 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:45.847659 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:26:45.855159 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.855159 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.950373 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:26:45.951948 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.952393 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.354359 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.355035 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:03.338623 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:27:03.360021 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:03.360481 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:03.531188 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:03.531628 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:03.532403 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:03.532802 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:03.547478 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Getting quotas for project 4319e24594eb450aa6aca572265ba4d0. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:03.551853 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Getting quotas for user bbdac15c5bdb45048cf00c1f7abc22ac and project 4319e24594eb450aa6aca572265ba4d0. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:03.562213 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:27:03.563139 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:03.563545 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:03.656412 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:27:03.658129 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:03.658695 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.042285 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.042617 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.221278 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:27:07.241022 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.241753 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.426142 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.426553 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.427316 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.427707 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.444643 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:07.453617 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:07.479370 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:27:07.480375 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.480793 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.556082 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:27:07.557556 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.558092 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.859519 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.860025 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:25.448235 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:27:25.500381 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:25.500859 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:25.636125 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:25.637404 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:25.638171 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:25.639494 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:25.684742 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:25.694845 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:25.707075 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:27:25.708344 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:25.708899 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:25.784191 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:27:25.785477 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:25.785885 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:26.048842 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:26.049341 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:27.072775 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:27:27.093290 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:27.093703 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:27.362799 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:27.363832 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:27.364789 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:27.365193 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:27.392728 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Getting quotas for project 17dfe7c4a9684f7ea504997e112332f2. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:27.406077 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Getting quotas for user 2a94f7988611413eae6103ea7d3ea293 and project 17dfe7c4a9684f7ea504997e112332f2. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:27.420842 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:27:27.422142 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:27.422744 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:27.535383 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:27:27.538250 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:27.539169 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:27.865535 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:27.865950 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.224237 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:27:40.249449 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.249859 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.453761 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.454178 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.454950 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.455355 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.472227 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:40.477334 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:40.489473 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:27:40.491065 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.491478 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.578142 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:27:40.581244 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.582099 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:41.055378 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:41.056056 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:54.403723 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:27:54.425141 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:54.428995 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:54.617130 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:54.617666 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:54.618502 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:54.618908 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:54.633836 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Getting quotas for project 6e5ed140aa524fbbab716a4dacfb8f01. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:54.638557 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Getting quotas for user 9080d662d57448d8804703b4c201b77b and project 6e5ed140aa524fbbab716a4dacfb8f01. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:54.649116 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:27:54.650058 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:54.650463 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:54.734558 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:27:54.735856 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:54.736328 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.039582 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.040403 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.714295 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:28:06.743496 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.743496 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.897175 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.897652 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.898457 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.898947 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.916523 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:06.921102 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:06.932758 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:28:06.933890 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.934475 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:07.006178 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:28:07.007463 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:07.007965 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:07.367898 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:07.368354 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:24.827553 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:28:24.849948 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:24.850357 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.115274 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:25.116875 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.117757 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:25.118293 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.141883 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Getting quotas for project 52fd97392841411abbd1f748dff97f10. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:25.147145 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Getting quotas for user f757f2aee71d4c3594cb45e10f3b9957 and project 52fd97392841411abbd1f748dff97f10. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:25.173969 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:28:25.175901 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:25.176534 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.300664 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:28:25.300664 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:25.300664 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.627713 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:25.628133 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:34.552309 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:28:34.582852 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:34.583484 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:34.777481 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:34.777889 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:34.778633 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:34.779030 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:34.794006 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:34.798564 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:34.810375 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:28:34.811311 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:34.811716 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:34.892299 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:28:34.893588 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:34.894002 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:35.193573 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:35.193991 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:39.187746 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:28:39.758095 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:28:39.805689 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:39.810953 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.141962 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.147107 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.148158 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.148741 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.182804 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:40.196075 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:40.222749 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:28:40.223801 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.224230 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.406201 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:28:40.406201 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.406201 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.920154 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.920866 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:11.633796 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:29:11.675537 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:11.676330 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:11.881565 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:11.882234 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:11.882978 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:11.883538 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:11.898822 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Getting quotas for project 52fd97392841411abbd1f748dff97f10. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:29:11.903812 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Getting quotas for user f757f2aee71d4c3594cb45e10f3b9957 and project 52fd97392841411abbd1f748dff97f10. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:29:11.918275 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:29:11.923040 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:11.923040 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:11.980497 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:29:11.982961 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:11.982961 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:12.302001 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:12.304341 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:37.917253 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:29:37.947507 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:37.948218 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:38.188353 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:38.188793 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:38.189932 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:38.190501 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:38.208686 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Getting quotas for project b9a42fbaedfa48bf9d1306ceb85b0e04. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:29:38.213839 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Getting quotas for user cf6771a45e3242d6ad4883d3b6ef314f and project b9a42fbaedfa48bf9d1306ceb85b0e04. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:29:38.227711 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:29:38.230766 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:38.230766 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:38.288393 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:29:38.289764 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:38.290178 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:38.586170 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:38.586412 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:47.567798 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:30:47.589957 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:47.590368 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:47.786641 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:47.787059 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:47.787804 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:47.788241 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:47.805144 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:30:47.811711 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for user e007558161974720bb11a4e7588af0c8 and project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:30:47.822622 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:30:47.823587 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:47.823999 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:47.899586 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:30:47.901044 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:47.901483 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:48.119157 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:48.119157 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.040611 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:31:32.088773 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.089748 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.362036 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.362478 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.371143 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.371954 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.477094 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:31:32.486312 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:31:32.509185 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:31:32.509185 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.509185 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.591011 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:31:32.594168 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.594792 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.924038 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.925359 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:33.444116 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:31:59.200210 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:32:27.614694 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:32:27.615240 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:27.615679 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:28.403220 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:32:29.290968 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Created allocations for migration 47b8a58c-2bb2-47e9-9043-59d492e3fdce on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:32:30.453723 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:32:34.711209 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:32:34.766359 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:34.766848 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.044370 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.045668 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.046509 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.046901 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.071456 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Getting quotas for project 85e899913f3f46e2b9ed44d5d6082195. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:32:35.078629 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Getting quotas for user c637fe804de14ee5986e914a3e0c9329 and project 85e899913f3f46e2b9ed44d5d6082195. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:32:35.098965 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:32:35.100916 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.101741 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.185869 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:32:35.187688 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.189038 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.464469 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.464888 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:08.463078 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method unshelve_instance {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:33:08.463610 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:08.463938 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:09.747654 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Requesting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) during scheduling {{(pid=128731) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:929}} Apr 16 21:33:10.804821 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Took 1.05 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:33:10.822409 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lazy-loading 'flavor' on Instance uuid b86e6830-cedb-4d55-a3b2-997462319b30 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:33:15.442483 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:33:15.491380 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:15.492547 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:15.797125 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:15.803626 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:15.812586 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:15.813970 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:15.862185 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Getting quotas for project 4f6fb0a879f54d85895e6b63f3b5ee5f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:33:15.881060 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Getting quotas for user bd17fc3dd855491cae4fa8119e9aeb50 and project 4f6fb0a879f54d85895e6b63f3b5ee5f. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:33:15.913542 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:33:15.917416 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:15.918063 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:16.025328 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:33:16.027402 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:16.028995 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:16.406254 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:16.407442 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:32.369295 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:34:32.396458 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:32.397051 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:32.599739 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:32.600478 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:32.601229 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:32.601617 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:32.618182 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for project 551fe53574564e4ea60f7288faf4298f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:32.622963 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for user d96d2c5371744a65806022c50819f800 and project 551fe53574564e4ea60f7288faf4298f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:32.634876 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:34:32.636339 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:32.636964 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:32.692337 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:34:32.694557 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:32.695190 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:32.998517 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:32.998933 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:52.901667 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:34:52.960895 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:52.961194 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.130818 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.131234 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.131999 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.136523 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.192004 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:53.214433 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:53.253097 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:34:53.254301 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.254867 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.303998 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:34:53.305554 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.305968 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.453626 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:34:53.666289 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.669728 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:10.970682 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:35:11.002222 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.002638 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:11.103186 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.103582 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:11.104570 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.104960 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:11.121470 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:35:11.125949 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for user e007558161974720bb11a4e7588af0c8 and project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:35:11.137497 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:35:11.141981 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.141981 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:11.253196 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:35:11.254646 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.255241 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:11.585705 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.586559 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:19.219556 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:36:20.428772 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:36:20.429942 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:20.430570 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:20.777530 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128732) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:36:21.631767 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Created allocations for migration 634730d8-ff9b-4758-9422-f7a904e1ea81 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:36:22.305485 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128732) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:36:45.304503 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method unshelve_instance {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:36:45.304503 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:45.304503 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:45.704532 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Requesting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) during scheduling {{(pid=128731) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:929}} Apr 16 21:36:46.159969 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:36:46.167541 ncdv-master-1 nova-conductor[128731]: DEBUG nova.objects.instance [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lazy-loading 'flavor' on Instance uuid 25cb82d7-b342-407d-8f63-71670d8f22d9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:36:59.486430 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:36:59.510397 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:59.511004 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:59.714090 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:59.714792 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:59.715690 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:59.717070 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:59.736744 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Getting quotas for project d51b576f9c0241c1a254f15308a455ec. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:36:59.742284 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Getting quotas for user 77f61ccbf5114e6080e33f0c5f500468 and project d51b576f9c0241c1a254f15308a455ec. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:36:59.755508 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:36:59.761899 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:59.761899 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:59.851112 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:36:59.854315 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:59.854938 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:00.303194 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:00.314683 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:11.836685 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:38:11.856776 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:11.857185 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:12.049249 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:12.050540 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:12.051282 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:12.051678 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:12.070287 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:38:12.075813 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:38:12.097774 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:38:12.098653 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:12.099221 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:12.206588 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:38:12.207414 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:12.207826 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:12.509712 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:12.510127 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:13.463228 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:38:39.229195 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:38:58.530231 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:38:58.530825 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:58.531053 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:59.283853 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Created allocations for migration 0de983e5-1034-464a-8bf5-da7ca579025e on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:38:59.351765 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.live_migrate [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Requesting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while live migrating {{(pid=128732) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:491}} Apr 16 21:38:59.810745 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lazy-loading 'resources' on Instance uuid 05be7894-901d-4845-be17-f6e12dc9f6f3 {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:38:59.814675 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lazy-loading 'pci_requests' on Instance uuid 05be7894-901d-4845-be17-f6e12dc9f6f3 {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:39:00.298057 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.live_migrate [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Start binding ports on destination host: nch2-master-1 {{(pid=128732) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Apr 16 21:39:37.339871 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:39:37.383157 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:37.384675 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:37.757716 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:37.758414 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:37.766804 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:37.772590 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:37.794201 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:37.800968 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for user 8b67f0226ea247ae857b18891e0834f8 and project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:37.821979 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:39:37.823886 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:37.824444 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:37.946206 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:39:37.946206 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:37.946206 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:38.343285 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:38.343875 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:40.311718 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:39:40.374990 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:40.378076 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:40.570918 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:40.571476 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:40.572354 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:40.572751 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:40.595784 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:40.602459 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:40.614841 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:39:40.616434 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:40.617027 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:40.766531 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:39:40.767841 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:40.768291 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.103833 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.104511 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:47.079736 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:39:47.129446 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.129862 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:47.404208 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.404884 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:47.405808 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.406352 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:47.442132 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Getting quotas for project c96a293eac61499182c2a30c324d461f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:47.449238 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Getting quotas for user f6e4f0060ec44989882b3b21624cb87a and project c96a293eac61499182c2a30c324d461f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:47.464555 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:39:47.465791 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.466582 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:47.535993 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:39:47.537797 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.538445 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:47.840523 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.840934 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:07.347863 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:40:07.369595 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:07.370005 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:07.637087 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:07.637490 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:07.638223 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:07.638624 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:07.653146 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:40:07.658203 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:40:07.668814 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:40:07.669727 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:07.670132 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:07.757692 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:40:07.759809 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:07.760650 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:08.090931 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:08.091446 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:51.847270 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:40:51.866665 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:51.867071 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:52.052441 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:52.052933 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:52.053670 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:52.054211 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:52.069477 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Getting quotas for project 80715ea8284b48959a67d33e8be6b560. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:40:52.074125 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Getting quotas for user 52bbf82f2ac64a4c9e3b86975f8173b2 and project 80715ea8284b48959a67d33e8be6b560. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:40:52.085281 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:40:52.086231 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:52.086637 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:52.214478 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] block_device_mapping [BlockDeviceMapping(attachment_id=4cf305a4-12bc-4b4e-8c11-2846e4aa00d7,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9312ec94-740a-4dce-bd71-1c9d823af28d',volume_size=1,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:40:52.214478 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:52.214478 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:52.526092 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:52.526505 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:06.946911 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method rebuild_instance {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:41:06.948920 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:06.950968 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:07.056936 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] No migration record for the rebuild/evacuate request. {{(pid=128732) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Apr 16 21:41:43.130535 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:41:43.151228 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:43.151705 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:43.288657 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:43.288980 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:43.289709 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:43.290101 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:43.305463 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:41:43.310666 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:41:43.321318 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:41:43.322202 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:43.322599 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:43.378871 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:41:43.380070 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:43.380506 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:43.594897 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:43.595839 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:59.241360 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:42:13.885546 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:42:22.341601 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:42:22.375913 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:22.376360 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:22.580601 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:22.582453 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:22.584807 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:22.585394 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:22.626549 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:22.633218 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for user 8b67f0226ea247ae857b18891e0834f8 and project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:22.647754 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:42:22.649159 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:22.649788 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:22.737287 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:42:22.738547 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:22.738983 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:23.044789 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:23.045259 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:50.769173 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:42:50.789841 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:50.790255 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:50.920525 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:50.920932 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:50.921658 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:50.922053 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:50.937239 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:50.942030 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:50.954484 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:42:50.955491 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:50.955894 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:51.041269 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:42:51.042524 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:51.042931 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:51.368835 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:51.369247 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:01.643470 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:43:01.681678 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:01.683458 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:01.917288 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:01.917702 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:01.918448 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:01.918853 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:01.933905 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:43:01.938790 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for user 9213dce366cd4351a55e8e82b4c2f7b6 and project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:43:01.948913 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:43:01.950323 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:01.950725 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:02.007036 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:43:02.008351 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:02.008751 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:02.270694 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:02.271036 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.477899 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:44:02.291017 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:44:02.309552 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:02.309979 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:02.553210 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:02.553616 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:02.554352 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:02.554750 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:02.569774 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Getting quotas for project cda4f5ee41d2439e935ee0f658f465d4. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:44:02.574383 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Getting quotas for user 95bf99de7a594e209f995e62db441850 and project cda4f5ee41d2439e935ee0f658f465d4. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:44:02.585324 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:44:02.586228 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:02.586636 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:02.669452 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:44:02.670743 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:02.671151 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:02.937391 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:02.937715 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:32.959363 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:44:33.003010 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:33.003337 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:33.147700 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:33.148233 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:33.149072 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:33.149561 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:33.166316 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:44:33.177049 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for user 9213dce366cd4351a55e8e82b4c2f7b6 and project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:44:33.182148 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:44:33.183112 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:33.183734 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:33.291248 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:44:33.292655 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:33.292773 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:33.605162 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:33.605559 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:46.968341 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:44:46.986975 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:46.987391 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.186352 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.186763 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.187500 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.187888 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.204502 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Getting quotas for project a812c01aa9574c9abb3ae67bf117ce3c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:44:47.209363 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Getting quotas for user 418700d27b044ee797d574625d4352f5 and project a812c01aa9574c9abb3ae67bf117ce3c. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:44:47.220436 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:44:47.221400 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.221815 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.285297 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:44:47.286096 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.286612 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.527636 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.528049 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:19.251613 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:45:36.213632 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:45:36.233152 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:36.233556 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:36.437239 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:36.437669 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:36.438456 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:36.439050 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:36.455367 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Getting quotas for project 3a77b24c69964f2bb99a7ca0345df95d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:45:36.460014 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Getting quotas for user 8481c8e388fa4c2f97487215edb731d7 and project 3a77b24c69964f2bb99a7ca0345df95d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:45:36.471302 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:45:36.471854 ncdv-master-1 nova-conductor[128732]: DEBUG nova.scheduler.utils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Re-scheduling is disabled due to forcing a host (['nch1-master-1']) and/or node ([]) {{(pid=128732) populate_retry /opt/stack/nova/nova/scheduler/utils.py:976}} Apr 16 21:45:36.472652 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:36.473051 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:36.551627 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:45:36.552902 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:36.553314 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:36.858152 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:36.860430 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:48.543986 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:45:48.566075 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:48.566487 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:48.714963 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:48.715376 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:48.716112 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:48.716539 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:48.731534 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Getting quotas for project 3a77b24c69964f2bb99a7ca0345df95d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:45:48.736836 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Getting quotas for user 8481c8e388fa4c2f97487215edb731d7 and project 3a77b24c69964f2bb99a7ca0345df95d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:45:48.748203 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:45:48.749330 ncdv-master-1 nova-conductor[128731]: DEBUG nova.scheduler.utils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Re-scheduling is disabled due to forcing a host (['nch2-master-1']) and/or node ([]) {{(pid=128731) populate_retry /opt/stack/nova/nova/scheduler/utils.py:976}} Apr 16 21:45:48.752411 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:48.752411 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:48.858751 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:45:48.860374 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:48.861140 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:49.112417 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:49.112767 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:28.299515 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:46:28.329460 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:28.330216 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:28.437534 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:28.437944 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:28.438678 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:28.439071 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:28.454261 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Getting quotas for project cda4f5ee41d2439e935ee0f658f465d4. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:46:28.458899 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Getting quotas for user 95bf99de7a594e209f995e62db441850 and project cda4f5ee41d2439e935ee0f658f465d4. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:46:28.470178 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:46:28.471130 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:28.471534 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:28.607142 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:46:28.608999 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:28.609703 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:28.962843 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:28.963578 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:33.491218 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:46:46.115381 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:46:46.135217 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:46.141902 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:46.292240 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:46.293281 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:46.294021 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:46.294410 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:46.309523 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:46:46.314210 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:46:46.324919 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:46:46.325856 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:46.326248 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:46.398968 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='dbaffdb9-592f-43f8-8f98-1f062f804f7e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:46:46.400234 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:46.400638 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:46.641898 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:46.642313 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:32.952492 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:47:32.972659 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:32.973062 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:33.123197 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:33.123608 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:33.124373 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:33.124764 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:33.141467 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:47:33.146557 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:47:33.156632 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:47:33.157581 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:33.157977 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:33.244216 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] block_device_mapping [BlockDeviceMapping(attachment_id=94188eee-13fc-48e5-89c5-cc48a3345d59,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07e9f1ad-2e5e-4c0e-907f-ab51c873b678',volume_size=1,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:47:33.245435 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:33.246022 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:33.457532 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:33.457946 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:50.490150 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:47:50.510964 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:50.511345 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:50.670370 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:50.670860 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:50.674185 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:50.674185 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:50.687305 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:47:50.692627 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:47:50.703612 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:47:50.704638 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:50.705015 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:50.769699 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b98ad8a4-81cd-4741-bdff-771bedb7f94b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:47:50.770980 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:50.771388 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:51.005350 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:51.005697 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:39.262965 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:49:15.744380 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:49:15.763338 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:15.763691 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:15.857438 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:15.857852 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:15.858589 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:15.858988 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:15.874523 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:49:15.879066 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:49:15.890357 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:49:15.891294 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:15.891699 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:15.955359 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] block_device_mapping [BlockDeviceMapping(attachment_id=75e38fc5-f421-42c7-9d6c-b28384dfcf14,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b',volume_size=1,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:49:15.956682 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:15.957080 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:16.145720 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:16.146166 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:53.500239 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:50:31.072016 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:50:33.322916 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:51:59.272557 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:52:13.900034 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:52:16.255283 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:53:13.507801 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:53:28.927654 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:53:28.947399 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:28.947816 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:29.129663 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:29.129998 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:29.130730 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:29.131124 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:29.146111 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Getting quotas for project 48e225fe10944f3eb50816c44682da5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:53:29.150496 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Getting quotas for user 5645e9867fd84c088140b3f4c07463e6 and project 48e225fe10944f3eb50816c44682da5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:53:29.161429 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:53:29.162314 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:29.162711 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:29.229504 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:53:29.230723 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:29.231128 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:29.436034 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:29.436412 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:51.651409 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:53:51.672378 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:51.672804 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:51.861020 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:51.861425 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:51.862152 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:51.862541 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:51.877715 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Getting quotas for project efbd1717b6ff4d73b5187f4d19c05e4a. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:53:51.883162 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Getting quotas for user 20102d18ab024354aba47971a20d1595 and project efbd1717b6ff4d73b5187f4d19c05e4a. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:53:51.894158 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:53:51.895035 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:51.895433 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:51.993164 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:53:51.993164 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:51.993164 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:52.201016 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:52.201333 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:03.392708 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:54:03.393379 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:03.393743 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:03.654290 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:54:04.213834 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Created allocations for migration bab92eb7-4908-4a66-97e4-d82f69df12ac on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:54:04.677274 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"c419ac35-cde4-4dc1-9de3-3a64a500ee12": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c419ac35-cde4-4dc1-9de3-3a64a500ee12"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=c419ac35-cde4-4dc1-9de3-3a64a500ee12,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:54:49.634165 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:54:49.653698 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:49.654104 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:49.831457 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:49.831864 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:49.832629 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:49.833026 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:49.848265 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Getting quotas for project c5dd165bd07e4d8daffbfa8a93aad4e8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:54:49.853030 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Getting quotas for user 4be1280a437044ed84be6af90f62e642 and project c5dd165bd07e4d8daffbfa8a93aad4e8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:54:49.864033 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:54:49.864960 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:49.865353 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:49.947582 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:54:49.948822 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:49.949227 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:50.143915 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:50.144480 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.906938 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:55:01.907470 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.907837 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:02.088826 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:55:02.553862 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Created allocations for migration bbe7c9c1-afd7-41ad-8cc3-a9693e2d5e48 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:55:03.033514 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [Selection(allocation_request='{"allocations": {"318e6e80-3ef5-4e19-b0e2-e8df13c8518c": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["318e6e80-3ef5-4e19-b0e2-e8df13c8518c"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=318e6e80-3ef5-4e19-b0e2-e8df13c8518c,limits=SchedulerLimits,nodename='nch2-master-1',service_host='nch2-master-1')] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:55:19.281800 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:55:40.288877 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:55:40.308909 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.309361 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:40.413741 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.414154 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:40.414891 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.415284 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:40.430410 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Getting quotas for project c5dd165bd07e4d8daffbfa8a93aad4e8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:55:40.434972 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Getting quotas for user 4be1280a437044ed84be6af90f62e642 and project c5dd165bd07e4d8daffbfa8a93aad4e8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:55:40.445361 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:55:40.446288 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.446688 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:40.506967 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:55:40.508268 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.508796 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:40.697498 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.697999 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:51.906557 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:55:51.907087 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.907465 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:52.086312 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:55:52.501705 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Created allocations for migration fa65f671-77ea-4e09-a48f-28bc5a0ee07b on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:55:52.872348 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"c419ac35-cde4-4dc1-9de3-3a64a500ee12": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c419ac35-cde4-4dc1-9de3-3a64a500ee12"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=c419ac35-cde4-4dc1-9de3-3a64a500ee12,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:56:33.517209 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:56:46.259971 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:56:46.280080 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:46.280519 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:46.464293 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:46.464700 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:46.465455 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:46.465848 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:46.481619 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:56:46.486130 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:56:46.496886 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:56:46.497808 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:46.498210 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:46.566356 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:56:46.567507 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:46.567939 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:46.779800 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:46.780248 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.504353 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:57:00.504353 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:00.504353 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.710931 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:57:01.170312 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Created allocations for migration b3f0ac9b-367f-447d-8931-2c1d4e5bcd57 on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:57:01.623741 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"c419ac35-cde4-4dc1-9de3-3a64a500ee12": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c419ac35-cde4-4dc1-9de3-3a64a500ee12"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=c419ac35-cde4-4dc1-9de3-3a64a500ee12,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:57:49.780361 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:57:49.800800 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:49.801203 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:49.912005 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:49.912446 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:49.913180 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:49.913575 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:49.928872 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:57:49.933432 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:57:49.944569 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:57:49.945411 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:49.945811 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:50.002357 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:57:50.003546 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:50.003950 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:50.195316 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:50.195649 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:29.898987 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:58:29.899519 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:29.900039 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:30.089222 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:58:30.564483 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Created allocations for migration 688e0257-201b-4639-9d74-db6413e3adc1 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:58:31.039424 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [Selection(allocation_request='{"allocations": {"318e6e80-3ef5-4e19-b0e2-e8df13c8518c": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["318e6e80-3ef5-4e19-b0e2-e8df13c8518c"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=318e6e80-3ef5-4e19-b0e2-e8df13c8518c,limits=SchedulerLimits,nodename='nch2-master-1',service_host='nch2-master-1')] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:58:39.292411 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:58:50.489370 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:58:50.509625 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:50.514456 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:50.639697 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:50.640095 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:50.640843 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:50.641235 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:50.656575 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:58:50.661656 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:58:50.672663 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:58:50.673361 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:50.673784 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:50.738498 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:58:50.739677 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:50.740077 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:50.888216 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:50.888653 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:02.407974 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 21:59:02.409892 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:02.409892 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:02.617550 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 21:59:03.107460 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Created allocations for migration 355cb11a-32b5-40a4-9e5d-a43f2c9f4175 on c419ac35-cde4-4dc1-9de3-3a64a500ee12 {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 21:59:03.530525 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"c419ac35-cde4-4dc1-9de3-3a64a500ee12": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c419ac35-cde4-4dc1-9de3-3a64a500ee12"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=c419ac35-cde4-4dc1-9de3-3a64a500ee12,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 21:59:40.700732 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 21:59:40.720425 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:40.720832 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:40.818636 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:40.819032 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:40.819757 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:40.820147 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:40.835374 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:59:40.840221 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:59:40.850783 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 21:59:40.851663 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:40.852067 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:40.894339 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 21:59:40.895533 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:40.895934 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:41.099853 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:41.100290 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:53.524953 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:00:00.233155 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128731) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 22:00:00.233647 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:00.234057 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:00.506754 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128731) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 22:00:00.991083 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Created allocations for migration b3dc7ae1-fcac-4933-827a-d4b2f15c78d3 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128731) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 22:00:01.448835 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.tasks.migrate [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [Selection(allocation_request='{"allocations": {"318e6e80-3ef5-4e19-b0e2-e8df13c8518c": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["318e6e80-3ef5-4e19-b0e2-e8df13c8518c"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=318e6e80-3ef5-4e19-b0e2-e8df13c8518c,limits=SchedulerLimits,nodename='nch2-master-1',service_host='nch2-master-1')] {{(pid=128731) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 22:00:59.076719 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:00:59.097442 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:59.097846 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:59.307227 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:59.307525 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:59.308294 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:59.308688 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:59.324860 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Getting quotas for project ee72c3d0e55c4b0c833fdbb2209901dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:00:59.329506 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Getting quotas for user b16246330d7843268b6c1f72e10f5e1c and project ee72c3d0e55c4b0c833fdbb2209901dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:00:59.340623 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:00:59.341538 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:59.341943 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:59.405060 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:00:59.406265 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:59.406667 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:59.740690 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:59.741212 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:10.967457 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:01:10.988035 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:10.988521 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:11.130594 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:11.131062 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:11.131729 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:11.132121 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:11.146338 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Getting quotas for project ee72c3d0e55c4b0c833fdbb2209901dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:01:11.151325 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Getting quotas for user b16246330d7843268b6c1f72e10f5e1c and project ee72c3d0e55c4b0c833fdbb2209901dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:01:11.161833 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:01:11.162722 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:11.163125 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:11.223750 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:01:11.225032 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:11.225442 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:11.482803 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:11.483138 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:59.302909 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:02:24.251454 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:02:24.273583 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:24.273999 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:24.472267 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:24.472597 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:24.473325 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:24.473743 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:24.489588 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Getting quotas for project 151ed48abb644e47bbf210bbca563e3b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:02:24.494885 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Getting quotas for user c683afdee06e4958bc94e991dd18257b and project 151ed48abb644e47bbf210bbca563e3b. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:02:24.505340 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:02:24.506239 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:24.506648 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:24.547801 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='feb29549-0b94-4aeb-bd04-f5870f79b1ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:02:24.549013 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:24.549418 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:24.721576 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:24.721990 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:13.532836 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:03:51.089064 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:03:53.340774 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:04:37.896943 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:04:37.918110 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:37.918529 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:38.150497 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:38.150903 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:38.151635 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:38.152033 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:38.166426 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:04:38.171234 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:04:38.182936 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:04:38.183869 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:38.184377 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:38.277226 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:04:38.278484 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:38.279549 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:38.490842 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:38.491491 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:19.311297 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:05:33.916995 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:05:36.271862 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:05:43.050243 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:05:43.072286 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:43.072709 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:43.160813 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:43.161226 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:43.161961 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:43.162359 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:43.177449 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:05:43.181993 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:05:43.193455 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:05:43.194374 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:43.194775 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:43.265102 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:05:43.266780 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:43.267710 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:43.420620 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:43.421820 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:33.540382 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:07:11.098239 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:07:13.348935 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:07:31.468756 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:07:31.490533 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:31.491084 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:31.600497 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:31.600917 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:31.601691 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:31.602113 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:31.619750 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:07:31.625073 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:07:31.635673 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:07:31.636612 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:31.637561 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:31.703901 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:07:31.705205 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:31.705620 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:31.945622 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:31.946047 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:39.318843 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:08:48.789148 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method migrate_server {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 22:08:48.789686 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:48.790116 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:49.065718 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Restricting to cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) while migrating {{(pid=128732) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Apr 16 22:08:49.584769 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Created allocations for migration 6bc641ac-4cec-40a9-8eeb-03d8dfae0076 on 318e6e80-3ef5-4e19-b0e2-e8df13c8518c {{(pid=128732) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Apr 16 22:08:49.591587 ncdv-master-1 nova-conductor[128732]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [be301120-fea3-4b6b-ad8d-6ce6302197c1] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:08:50.599701 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [be301120-fea3-4b6b-ad8d-6ce6302197c1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45694. Apr 16 22:08:53.163070 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.tasks.migrate [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [Selection(allocation_request='{"allocations": {"318e6e80-3ef5-4e19-b0e2-e8df13c8518c": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["318e6e80-3ef5-4e19-b0e2-e8df13c8518c"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=f8d025b3-2d37-4d38-9ad5-4c1987181ef2,compute_node_uuid=318e6e80-3ef5-4e19-b0e2-e8df13c8518c,limits=SchedulerLimits,nodename='nch2-master-1',service_host='nch2-master-1')] {{(pid=128732) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Apr 16 22:08:53.174071 ncdv-master-1 nova-conductor[128732]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [d3628760-016a-49b5-8844-4cdd883a41f4] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:08:54.180467 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [d3628760-016a-49b5-8844-4cdd883a41f4] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45720. Apr 16 22:09:53.547832 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:10:00.502983 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:10:00.523668 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:00.524147 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:00.646362 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:00.648103 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:00.648103 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:00.648704 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:00.665009 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:10:00.670008 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:10:00.681639 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:10:00.682612 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:00.683024 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:00.742093 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:10:00.743386 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:00.743803 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:00.994978 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:00.995500 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:59.327419 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:12:11.107718 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:12:43.773004 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:12:43.803286 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:43.803720 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:43.927880 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:43.928484 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:43.929219 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:43.929607 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:43.956944 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:12:43.963735 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:12:43.976001 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:12:43.981722 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:43.981722 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:44.046594 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:12:44.047820 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:44.048275 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:44.280291 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:44.280872 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:13.563567 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:14:04.310373 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:14:04.330612 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:04.335401 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:04.529446 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:04.529843 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:04.530565 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:04.530963 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:04.545248 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for project 8a91917b203d4a2ca179d394e04af71f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:14:04.549773 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for user 37ff1c2e4f3b45f589d675028674ecb3 and project 8a91917b203d4a2ca179d394e04af71f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:14:04.560065 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:14:04.560983 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:04.561384 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:04.658104 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:14:04.659475 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:04.659925 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:04.911318 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:04.911725 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:15:19.336495 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:15:33.933920 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:15:36.286448 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:16:33.571611 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:16:40.048907 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Targeting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for conductor method unshelve_instance {{(pid=128732) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Apr 16 22:16:40.049417 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:40.049818 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:40.623509 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Requesting cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) during scheduling {{(pid=128732) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:929}} Apr 16 22:16:41.154937 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:16:41.162673 ncdv-master-1 nova-conductor[128732]: DEBUG nova.objects.instance [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lazy-loading 'flavor' on Instance uuid 2bafbfec-97cd-4628-87cd-2963042e626b {{(pid=128732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:17:11.116685 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:17:13.362812 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:18:39.346374 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:18:54.439659 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:18:54.461072 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:54.461498 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:54.576904 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:54.577296 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:54.578127 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:54.578572 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:54.593886 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for project 8a91917b203d4a2ca179d394e04af71f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:18:54.598542 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for user 37ff1c2e4f3b45f589d675028674ecb3 and project 8a91917b203d4a2ca179d394e04af71f. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:18:54.609813 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:18:54.610671 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:54.611075 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:54.662284 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] block_device_mapping [BlockDeviceMapping(attachment_id=07cd8141-e373-4070-8d4c-772ea7a4c9ea,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='716d5dcf-9ded-4bb8-b567-3f9363383a4c',volume_size=1,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:18:54.663526 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:54.663939 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:54.886255 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:54.886667 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:53.579827 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:21:59.355751 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:22:11.125434 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:22:13.372054 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:22:13.945471 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:22:16.296920 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:23:13.587885 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:23:15.194521 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=128732) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:23:15.216096 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:15.216532 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:15.392964 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:15.393293 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:15.394018 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:15.394408 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:15.409765 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:23:15.414596 ncdv-master-1 nova-conductor[128732]: DEBUG nova.quota [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for user 9fdf8094a9314b31a4fa61a9abe18cc9 and project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'ram', 'instances', 'cores'} {{(pid=128732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:23:15.427870 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=128732) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:23:15.429055 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:15.429459 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:15.496910 ncdv-master-1 nova-conductor[128732]: DEBUG nova.conductor.manager [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128732) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:23:15.498319 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:15.498567 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:15.675997 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:15.676336 ncdv-master-1 nova-conductor[128732]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:19.363592 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:25:31.134313 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:25:33.380400 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:25:36.304819 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:25:40.251019 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=128731) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Apr 16 22:25:40.269909 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:40.270316 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:40.417814 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:40.418241 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:40.419020 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:40.419512 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:40.434689 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:25:40.441929 ncdv-master-1 nova-conductor[128731]: DEBUG nova.quota [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for user 9fdf8094a9314b31a4fa61a9abe18cc9 and project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'ram', 'instances', 'cores'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:25:40.451040 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=128731) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Apr 16 22:25:40.451973 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:40.452404 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:40.523141 ncdv-master-1 nova-conductor[128731]: DEBUG nova.conductor.manager [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='972220ce-a1dc-4f93-ac77-156cdd67ae5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Apr 16 22:25:40.524371 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:40.524771 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:40.746359 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:40.746739 ncdv-master-1 nova-conductor[128731]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:33.597646 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:28:39.371278 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:28:51.142932 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:28:53.388025 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:28:53.956262 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:28:56.313406 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:29:53.617028 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:31:59.379936 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:32:11.150794 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:32:13.396541 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:32:13.967139 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:32:16.322724 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:33:13.624912 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:35:19.387873 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:35:31.157748 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:35:33.404359 ncdv-master-1 nova-conductor[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:35:33.974583 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:35:36.330030 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:36:33.632248 ncdv-master-1 nova-conductor[128732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer