-- Logs begin at Sat 2022-07-16 20:01:20 UTC, end at Sat 2022-07-16 22:45:11 UTC. -- Jul 16 20:57:55.067510 ncdv-master-1 systemd[1]: Started Devstack devstack@n-super-cond.service. Jul 16 20:57:56.375099 ncdv-master-1 nova-conductor[128929]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 16 20:57:59.274281 ncdv-master-1 nova-conductor[128929]: INFO dbcounter [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Registered counter for database nova_api Jul 16 20:57:59.295152 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_db.sqlalchemy.engines [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 20:57:59.301724 ncdv-master-1 nova-conductor[128929]: DEBUG dbcounter [-] [128929] Writer thread running {{(pid=128929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 20:57:59.354536 ncdv-master-1 nova-conductor[128929]: DEBUG nova.context [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) {{(pid=128929) load_cells /opt/stack/nova/nova/context.py:464}} Jul 16 20:57:59.359447 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_concurrency.lockutils [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 20:57:59.360905 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_concurrency.lockutils [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 20:57:59.361610 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_concurrency.lockutils [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 20:57:59.363381 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_concurrency.lockutils [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 20:57:59.365197 ncdv-master-1 nova-conductor[128929]: INFO dbcounter [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Registered counter for database nova_cell0 Jul 16 20:57:59.368825 ncdv-master-1 nova-conductor[128929]: INFO dbcounter [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Registered counter for database nova_cell1 Jul 16 20:57:59.380594 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_db.sqlalchemy.engines [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 20:57:59.383073 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_db.sqlalchemy.engines [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 20:57:59.387106 ncdv-master-1 nova-conductor[128929]: DEBUG dbcounter [-] [128929] Writer thread running {{(pid=128929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 20:57:59.516868 ncdv-master-1 nova-conductor[128929]: DEBUG dbcounter [-] [128929] Writer thread running {{(pid=128929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 20:57:59.525750 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_concurrency.lockutils [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Acquired lock "singleton_lock" {{(pid=128929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 16 20:57:59.526323 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_concurrency.lockutils [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Releasing lock "singleton_lock" {{(pid=128929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 16 20:57:59.527158 ncdv-master-1 nova-conductor[128929]: INFO oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Starting 2 workers Jul 16 20:57:59.532014 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Started child 129815 {{(pid=128929) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jul 16 20:57:59.537293 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Started child 129816 {{(pid=128929) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jul 16 20:57:59.538602 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Full set of CONF: {{(pid=128929) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jul 16 20:57:59.538904 ncdv-master-1 nova-conductor[129815]: INFO nova.service [-] Starting conductor node (version 25.1.0) Jul 16 20:57:59.539475 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ******************************************************************************** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 16 20:57:59.539637 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] Configuration options gathered from: {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 16 20:57:59.540121 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 16 20:57:59.540907 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] config files: ['/etc/nova/nova.conf'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 16 20:57:59.541344 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ================================================================================ {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 16 20:57:59.542187 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] allow_resize_to_same_host = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.542767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] arq_binding_timeout = 300 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.543329 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] block_device_allocate_retries = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.543857 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] block_device_allocate_retries_interval = 3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.544449 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cert = self.pem {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.544957 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute_driver = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.545691 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute_monitors = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.546419 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] config_dir = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.547123 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] config_drive_format = iso9660 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.547674 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.548335 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] config_source = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.548967 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] console_host = ncdv-master-1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.549604 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] control_exchange = nova {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.550266 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cpu_allocation_ratio = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.550897 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] daemon = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.551580 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] debug = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.552689 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] default_access_ip_network_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.553318 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] default_availability_zone = nova {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.553928 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] default_ephemeral_format = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.554763 ncdv-master-1 nova-conductor[129816]: INFO nova.service [-] Starting conductor node (version 25.1.0) Jul 16 20:57:59.555811 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.556492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] default_schedule_zone = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.557125 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] disk_allocation_ratio = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.557310 ncdv-master-1 nova-conductor[129815]: INFO dbcounter [None req-082f524e-37e4-4497-96b5-382ab081e451 None None] Registered counter for database nova_cell0 Jul 16 20:57:59.557849 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] enable_new_services = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.558546 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] enabled_apis = ['osapi_compute'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.559182 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] enabled_ssl_apis = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.559831 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] flat_injected = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.560426 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] force_config_drive = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.561037 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] force_raw_images = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.561661 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] graceful_shutdown_timeout = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.562258 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] heal_instance_info_cache_interval = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.563710 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] host = ncdv-master-1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.564386 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.564998 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] initial_disk_allocation_ratio = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.565660 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] initial_ram_allocation_ratio = 1.5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.566452 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.567217 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] instance_build_timeout = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.568446 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] instance_delete_interval = 300 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.569257 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] instance_format = [instance: %(uuid)s] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.569957 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] instance_name_template = instance-%08x {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.570580 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] instance_usage_audit = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.571257 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] instance_usage_audit_period = month {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.571856 ncdv-master-1 nova-conductor[129816]: INFO dbcounter [None req-4e428b8e-0d7a-4234-9895-7895e02eb156 None None] Registered counter for database nova_cell0 Jul 16 20:57:59.572075 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.572684 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] instances_path = /opt/stack/data/nova/instances {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.573314 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] internal_service_availability_zone = internal {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.573589 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_db.sqlalchemy.engines [None req-082f524e-37e4-4497-96b5-382ab081e451 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 20:57:59.574129 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] key = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.574736 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] live_migration_retry_count = 30 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.575387 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] log_config_append = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.576019 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.576649 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] log_dir = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.577247 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] log_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.577775 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] log_options = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.578388 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] log_rotate_interval = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.579029 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] log_rotate_interval_type = days {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.579652 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] log_rotation_type = none {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.580207 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.580737 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.581360 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.581988 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.582529 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.583182 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] long_rpc_timeout = 1800 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.583909 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] max_concurrent_builds = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.584527 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] max_concurrent_live_migrations = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.585120 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] max_concurrent_snapshots = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.585222 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writer thread running {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 20:57:59.585851 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] max_local_block_devices = 3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.586464 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] max_logfile_count = 30 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.587073 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] max_logfile_size_mb = 200 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.587659 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] maximum_instance_delete_attempts = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.588268 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] metadata_listen = 0.0.0.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.589024 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] metadata_listen_port = 8775 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.589636 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] metadata_workers = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.590228 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] migrate_max_retries = -1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.590872 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] mkisofs_cmd = genisoimage {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.591635 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] my_block_storage_ip = 10.222.0.16 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.592258 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] my_ip = 10.222.0.16 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.592869 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] network_allocate_retries = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.593482 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.594090 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] osapi_compute_listen = 0.0.0.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.594676 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] osapi_compute_listen_port = 8774 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.596072 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] osapi_compute_unique_server_name_scope = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.596684 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] osapi_compute_workers = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.597296 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] password_length = 12 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.597883 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] periodic_enable = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.598477 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] periodic_fuzzy_delay = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.599189 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] pointer_model = usbtablet {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.602630 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] preallocate_images = none {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.603357 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] publish_errors = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.603502 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_db.sqlalchemy.engines [None req-4e428b8e-0d7a-4234-9895-7895e02eb156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 20:57:59.604090 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] pybasedir = /opt/stack/nova {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.604695 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ram_allocation_ratio = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.607361 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] rate_limit_burst = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.608035 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] rate_limit_except_level = CRITICAL {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.608639 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] rate_limit_interval = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.609253 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] reboot_timeout = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.610093 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] reclaim_instance_interval = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.610726 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] record = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.610844 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writer thread running {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 20:57:59.611564 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] report_interval = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.612160 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] rescue_timeout = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.612761 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] reserved_host_cpus = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.613351 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] reserved_host_disk_mb = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.615133 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] reserved_host_memory_mb = 512 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.615785 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] reserved_huge_pages = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.616379 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] resize_confirm_window = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.616981 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] resize_fs_using_block_device = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.617584 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] resume_guests_state_on_host_boot = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.618209 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.618820 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] rpc_response_timeout = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.619473 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] run_external_periodic_tasks = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.620102 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] running_deleted_instance_action = reap {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.620707 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.621304 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] running_deleted_instance_timeout = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.621897 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler_instance_sync_interval = 120 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.622498 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_down_time = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.623192 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] servicegroup_driver = db {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.623961 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] shelved_offload_time = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.624595 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] shelved_poll_interval = 3600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.625267 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] shutdown_timeout = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.625868 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] source_is_ipv6 = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.626490 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ssl_only = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.627137 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] state_path = /opt/stack/data/nova {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.627757 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] sync_power_state_interval = 600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.628405 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] sync_power_state_pool_size = 1000 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.629011 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] syslog_log_facility = LOG_USER {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.629595 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] tempdir = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.631073 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] timeout_nbd = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643135 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] transport_url = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643135 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] update_resources_interval = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643135 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] use_cow_images = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643135 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] use_eventlog = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643135 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] use_journal = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643135 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] use_json = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643135 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] use_rootwrap_daemon = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643784 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] use_stderr = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643784 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] use_syslog = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643784 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vcpu_pin_set = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643784 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vif_plugging_is_fatal = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643784 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vif_plugging_timeout = 300 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643784 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] virt_mkfs = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.643784 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] volume_usage_poll_interval = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.644503 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] watch_log_file = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.644503 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] web = /usr/share/spice-html5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:57:59.644503 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_concurrency.disable_process_locking = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.644503 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.644503 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.644503 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.645019 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.645019 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.645019 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.645019 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.auth_strategy = keystone {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.647123 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.compute_link_prefix = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.647978 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.648910 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.dhcp_domain = novalocal {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.649756 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.enable_instance_password = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.650491 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.glance_link_prefix = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.651187 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.651833 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.652451 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.instance_list_per_project_cells = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.653046 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.list_records_by_skipping_down_cells = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.653654 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.local_metadata_per_cell = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.654252 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.max_limit = 1000 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.655035 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.metadata_cache_expiration = 15 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.655563 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.neutron_default_tenant_id = default {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.656104 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.use_forwarded_for = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.656605 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.use_neutron_default_nets = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.657125 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.657617 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.658129 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.658640 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.659256 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.vendordata_dynamic_targets = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.659720 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.vendordata_jsonfile_path = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.660202 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.660783 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.backend = dogpile.cache.memcached {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.661366 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.backend_argument = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.662140 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.config_prefix = cache.oslo {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.662639 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.dead_timeout = 60.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.663229 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.debug_cache_backend = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.663635 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.enable_retry_client = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.664094 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.enable_socket_keepalive = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.664559 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.enabled = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.665042 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.expiration_time = 600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.665510 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.hashclient_retry_attempts = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.665966 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.hashclient_retry_delay = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.666524 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.memcache_dead_retry = 300 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.666941 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.671597 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.671597 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.memcache_pool_maxsize = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.671597 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.671597 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.671597 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.memcache_socket_timeout = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.671597 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.proxies = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.671597 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.retry_attempts = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.672138 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.retry_delay = 0.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.672138 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.socket_keepalive_count = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.672138 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.socket_keepalive_idle = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.672138 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.socket_keepalive_interval = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.672591 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.tls_allowed_ciphers = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.672992 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.tls_cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.673394 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.tls_certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.673785 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.tls_enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.674172 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cache.tls_keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.674616 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.auth_section = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.675038 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.auth_type = password {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.675418 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.676002 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.catalog_info = volumev3::publicURL {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.676394 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.676798 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.677824 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.cross_az_attach = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.678467 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.debug = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.678566 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.endpoint_template = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.678916 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.http_retries = 3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.679492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.679872 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.680273 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.os_region_name = RegionOne {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.680665 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.681048 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cinder.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.681452 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.681841 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.cpu_dedicated_set = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.682218 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.cpu_shared_set = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.682610 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.image_type_exclude_list = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.683093 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.683440 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.683820 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.684198 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.684592 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.685047 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.resource_provider_association_refresh = 300 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.685357 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] compute.shutdown_retry_interval = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.685912 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] conductor.workers = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.686623 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] console.allowed_origins = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.686731 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] console.ssl_ciphers = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.687084 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] console.ssl_minimum_version = default {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.688081 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] consoleauth.token_ttl = 600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.688081 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.690295 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.690295 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.690295 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.connect_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.690295 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.connect_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.690295 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.endpoint_override = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.690896 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.690896 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.691948 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.max_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.691948 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.min_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.691948 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.region_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.692500 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.service_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.693257 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.service_type = accelerator {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.693789 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.694414 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.status_code_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.694793 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.status_code_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.695219 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.695663 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.702767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] cyborg.version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.702767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.backend = sqlalchemy {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.702767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.connection = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.702767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.connection_debug = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.702767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.connection_parameters = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.702767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.connection_recycle_time = 3600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.702767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.connection_trace = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.703492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.db_inc_retry_interval = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.703492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.db_max_retries = 20 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.703492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.db_max_retry_interval = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.703492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.db_retry_interval = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.703492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.max_overflow = 50 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.703492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.max_pool_size = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.703492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.max_retries = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704179 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.mysql_enable_ndb = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704179 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704179 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.pool_timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704179 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.retry_interval = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704179 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.slave_connection = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704179 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.sqlite_synchronous = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704179 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] database.use_db_reconnect = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704578 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.backend = sqlalchemy {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.704679 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.connection = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.705223 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.connection_debug = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.705767 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.connection_parameters = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.706309 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.connection_recycle_time = 3600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.706695 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.connection_trace = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.707110 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.db_inc_retry_interval = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.707486 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.db_max_retries = 20 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.707967 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.db_max_retry_interval = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.708998 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.db_retry_interval = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.709455 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.max_overflow = 50 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.709838 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.max_pool_size = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.710275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.max_retries = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.710833 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.mysql_enable_ndb = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.711254 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.711639 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.pool_timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.712065 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.retry_interval = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.712443 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.slave_connection = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.712907 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] api_database.sqlite_synchronous = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.713338 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] devices.enabled_mdev_types = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.713765 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.714158 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ephemeral_storage_encryption.enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.714534 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.714948 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.api_servers = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.715349 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.715758 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.716109 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.716492 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.connect_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.716860 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.connect_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.717240 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.debug = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.717716 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.default_trusted_certificate_ids = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.718111 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.enable_certificate_validation = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.718483 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.enable_rbd_download = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.718886 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.endpoint_override = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.719379 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.719762 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.720143 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.max_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.720518 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.min_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.720899 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.num_retries = 3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.721298 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.rbd_ceph_conf = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.721683 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.rbd_connect_timeout = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.722080 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.rbd_pool = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.722473 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.rbd_user = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.722851 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.region_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.723249 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.service_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.724527 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.service_type = image {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.725117 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.725630 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.status_code_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.726315 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.status_code_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.726864 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.727479 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.728977 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.verify_glance_signatures = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.728977 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] glance.version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.729159 ncdv-master-1 nova-conductor[129815]: DEBUG nova.service [None req-082f524e-37e4-4497-96b5-382ab081e451 None None] Creating RPC server for service conductor {{(pid=129815) start /opt/stack/nova/nova/service.py:182}} Jul 16 20:57:59.729254 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] guestfs.debug = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.729722 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.config_drive_cdrom = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.730251 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.config_drive_inject_password = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.730786 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.731355 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.731934 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.enable_remotefx = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.732507 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.instances_path_share = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.733053 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.iscsi_initiator_list = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.733587 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.limit_cpu_features = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.734115 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.734643 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.735194 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.735743 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.736347 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.736901 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.use_multipath_io = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.737429 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.737967 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.738486 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.vswitch_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.739121 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.739861 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] mks.enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.741093 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.741706 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] image_cache.manager_interval = 2400 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.742293 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] image_cache.precache_concurrency = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.742879 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] image_cache.remove_unused_base_images = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.743470 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.744043 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.744638 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] image_cache.subdirectory_name = _base {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.745251 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.api_max_retries = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.745829 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.api_retry_interval = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.746385 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.auth_section = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.747041 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.auth_type = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.747803 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.748354 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.748903 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754471 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.connect_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754471 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.connect_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754471 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.endpoint_override = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754471 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754471 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754471 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.max_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754471 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.min_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754978 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.partition_key = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754978 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.peer_list = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754978 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.region_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754978 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.serial_console_state_timeout = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.754978 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.service_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.755931 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.service_type = baremetal {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.756511 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.757079 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.status_code_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.757641 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.status_code_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.758431 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.759687 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.760283 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ironic.version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.762562 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.763275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] key_manager.fixed_key = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.765584 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.766045 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.barbican_api_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.766463 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.barbican_endpoint = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.766912 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.barbican_endpoint_type = public {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.774448 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.barbican_region_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.774448 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.774448 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.774448 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.774448 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.774448 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.774448 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.number_of_retries = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775077 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.retry_delay = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775077 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.send_service_user_token = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775077 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775077 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775077 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.verify_ssl = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775077 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican.verify_ssl_path = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775077 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.auth_section = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775502 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.auth_type = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.775582 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.776370 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.776370 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.776779 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.777151 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.779221 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.779609 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] barbican_service_user.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.780852 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.approle_role_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.781291 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.approle_secret_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.783897 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.792193 ncdv-master-1 nova-conductor[129816]: DEBUG nova.service [None req-4e428b8e-0d7a-4234-9895-7895e02eb156 None None] Creating RPC server for service conductor {{(pid=129816) start /opt/stack/nova/nova/service.py:182}} Jul 16 20:57:59.795928 ncdv-master-1 nova-conductor[129815]: DEBUG nova.service [None req-082f524e-37e4-4497-96b5-382ab081e451 None None] Join ServiceGroup membership for this service conductor {{(pid=129815) start /opt/stack/nova/nova/service.py:199}} Jul 16 20:57:59.796370 ncdv-master-1 nova-conductor[129815]: DEBUG nova.servicegroup.drivers.db [None req-082f524e-37e4-4497-96b5-382ab081e451 None None] DB_Driver: join new ServiceGroup member ncdv-master-1 to the conductor group, service = {{(pid=129815) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jul 16 20:57:59.797760 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.798204 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.798793 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.799233 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.800103 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.kv_mountpoint = secret {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.800514 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.kv_version = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.800919 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.namespace = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.801317 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.root_token_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.801716 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.802149 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.ssl_ca_crt_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.802542 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.802941 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.use_ssl = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.803449 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.804531 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.804932 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.805332 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.805726 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.connect_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.806124 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.connect_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.806515 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.endpoint_override = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.806925 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.807349 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.807733 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.max_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.808131 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.min_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.808525 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.region_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.809028 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.service_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.809436 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.service_type = identity {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.809865 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.810431 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.status_code_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.811000 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.status_code_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.811582 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.812161 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.813185 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] keystone.version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.813861 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.connection_uri = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.814424 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.cpu_mode = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.814983 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.cpu_model_extra_flags = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.815584 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.cpu_models = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.816146 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.device_detach_attempts = 8 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.816682 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.device_detach_timeout = 20 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.823603 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.disk_cachemodes = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.823603 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.disk_prefix = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.823603 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.enabled_perf_events = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.823603 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.file_backed_memory = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.823603 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.gid_maps = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.823603 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.hw_disk_discard = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.823603 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.hw_machine_type = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.824175 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.images_rbd_ceph_conf = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.824175 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.824175 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.824175 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.images_rbd_glance_store_name = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.824175 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.images_rbd_pool = rbd {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.824175 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.images_type = default {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.824699 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.images_volume_group = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.825295 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.inject_key = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.825843 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.inject_partition = -2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.826414 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.inject_password = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.827052 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.iscsi_iface = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.827850 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.iser_use_multipath = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.831577 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.834882 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.835658 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_downtime = 500 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.837558 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.838990 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.840235 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_inbound_addr = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.840919 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.841483 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.841960 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_scheme = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.842582 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_timeout_action = abort {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.843468 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_tunnelled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.844501 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_uri = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.844921 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.live_migration_with_native_tls = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.845500 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.max_queues = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.846101 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.846484 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.nfs_mount_options = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.847152 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.847760 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.848221 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.num_iser_scan_tries = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.848629 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.849211 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.849463 ncdv-master-1 nova-conductor[129816]: DEBUG nova.service [None req-4e428b8e-0d7a-4234-9895-7895e02eb156 None None] Join ServiceGroup membership for this service conductor {{(pid=129816) start /opt/stack/nova/nova/service.py:199}} Jul 16 20:57:59.849726 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.num_pcie_ports = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.850136 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.num_volume_scan_tries = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.850587 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.pmem_namespaces = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.850886 ncdv-master-1 nova-conductor[129816]: DEBUG nova.servicegroup.drivers.db [None req-4e428b8e-0d7a-4234-9895-7895e02eb156 None None] DB_Driver: join new ServiceGroup member ncdv-master-1 to the conductor group, service = {{(pid=129816) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jul 16 20:57:59.851135 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.quobyte_client_cfg = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.851639 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.852041 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rbd_connect_timeout = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.854833 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.854833 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.854833 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rbd_secret_uuid = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.854833 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rbd_user = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.854833 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.854833 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.855334 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rescue_image_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.855677 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rescue_kernel_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.856065 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rescue_ramdisk_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.856469 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.856858 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.rx_queue_size = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.857259 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.smbfs_mount_options = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.857754 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.858146 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.snapshot_compression = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.858537 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.snapshot_image_format = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.859050 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.859433 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.sparse_logical_volumes = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.859830 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.swtpm_enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.860237 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.swtpm_group = tss {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.863931 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.swtpm_user = tss {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.863931 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.sysinfo_serial = unique {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.863931 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.tx_queue_size = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.863931 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.uid_maps = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.863931 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.use_virtio_for_bridges = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.863931 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.virt_type = kvm {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.863931 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.volume_clear = zero {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.864456 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.volume_clear_size = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.864456 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.volume_use_multipath = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.864456 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.vzstorage_cache_path = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.865055 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.865753 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.vzstorage_mount_group = qemu {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.866166 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.vzstorage_mount_opts = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.866574 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.867097 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.867514 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.vzstorage_mount_user = stack {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.867915 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.868344 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.auth_section = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.868764 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.auth_type = password {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.869149 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.869533 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.870269 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.870269 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.connect_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.870661 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.connect_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.871211 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.default_floating_pool = public {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.871612 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.endpoint_override = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.872007 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.extension_sync_interval = 600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.876540 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.http_retries = 3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.876540 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.876540 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.876540 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.max_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.876540 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.876540 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.min_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.876540 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.ovs_bridge = br-int {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.877128 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.physnets = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.877128 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.region_name = RegionOne {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.877252 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.service_metadata_proxy = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.877775 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.service_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.878406 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.service_type = network {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.878595 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.878974 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.status_code_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.879390 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.status_code_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.879773 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.880845 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.881963 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] neutron.version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.882526 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] notifications.bdms_in_notifications = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.883151 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] notifications.default_level = INFO {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.883561 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] notifications.notification_format = unversioned {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.883953 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] notifications.notify_on_state_change = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.884364 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.884803 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] pci.alias = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.885210 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] pci.passthrough_whitelist = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.885657 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.auth_section = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.886077 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.auth_type = password {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.886478 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.auth_url = http://10.222.0.16/identity {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.886861 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.887291 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.887684 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.888091 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.connect_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.888480 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.connect_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.888880 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.default_domain_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.889285 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.default_domain_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.889663 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.domain_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.890043 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.domain_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.890432 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.endpoint_override = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.890814 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.891219 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.891603 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.max_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.892102 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.min_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.893213 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.password = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.893622 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.project_domain_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.894275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.project_domain_name = Default {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.894678 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.project_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.895271 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.project_name = service {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.895828 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.region_name = RegionOne {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.896718 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.service_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.897130 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.service_type = placement {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.897577 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.897969 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.status_code_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.898358 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.status_code_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.898749 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.system_scope = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.899166 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.899605 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.trust_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.900007 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.user_domain_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.900606 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.user_domain_name = Default {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.901159 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.user_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.901593 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.username = placement {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.902186 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.902582 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] placement.version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.903081 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] powervm.disk_driver = localdisk {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.903507 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] powervm.proc_units_factor = 0.1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.903940 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] powervm.volume_group_name = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.904373 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.cores = 20 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.904765 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.count_usage_from_placement = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.905163 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.905575 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.injected_file_content_bytes = 10240 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.905966 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.injected_file_path_length = 255 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.906355 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.injected_files = 5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.906750 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.instances = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.907171 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.key_pairs = 100 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.907562 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.metadata_items = 128 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.907967 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.ram = 51200 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.908354 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.recheck_quota = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.908742 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.server_group_members = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.909128 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] quota.server_groups = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.909531 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] rdp.enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.910160 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.910564 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.911186 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.912561 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.image_metadata_prefilter = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.912890 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.917858 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.max_attempts = 3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.917858 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.max_placement_results = 1000 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.917858 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.917858 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.query_placement_for_availability_zone = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.917858 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.917858 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] scheduler.workers = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918275 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918664 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918664 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.918826 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.919391 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.host_subset_size = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.919953 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.920348 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.920739 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.isolated_hosts = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.921130 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.isolated_images = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.921523 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.921907 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.922409 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.922823 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.923247 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.923636 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.924062 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.924490 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.924938 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.track_instance_changes = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.925351 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.925747 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] metrics.required = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.926137 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] metrics.weight_multiplier = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.926527 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.927614 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] metrics.weight_setting = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.928598 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.929220 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] serial_console.enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.929926 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] serial_console.port_range = 10000:20000 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.930571 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.931237 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.931878 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] serial_console.serialproxy_port = 6083 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.932566 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.auth_section = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.933213 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.auth_type = password {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.933816 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.934425 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.935094 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.935681 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.936285 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.936926 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.send_service_user_token = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.937697 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.938331 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] service_user.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.938981 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] spice.agent_enabled = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.939634 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] spice.enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.940634 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.941559 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.942187 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] spice.html5proxy_port = 6082 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.943453 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] spice.server_listen = 127.0.0.1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.943989 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947176 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] upgrade_levels.baseapi = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947176 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] upgrade_levels.cert = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947176 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] upgrade_levels.compute = auto {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947176 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] upgrade_levels.conductor = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947176 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] upgrade_levels.scheduler = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947176 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947176 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947798 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947798 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.947957 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.948340 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.948723 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.949383 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.949773 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vendordata_dynamic_auth.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.950224 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.api_retry_count = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.951196 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.ca_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.951608 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.cache_prefix = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.952287 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.cluster_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.952742 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.connection_pool_size = 10 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.953133 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.console_delay_seconds = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.953513 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.datastore_regex = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.953897 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.host_ip = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.954279 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.host_password = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.954839 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.host_port = 443 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.955250 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.host_username = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.955653 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.956042 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.integration_bridge = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.956432 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.maximum_objects = 100 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.956817 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.pbm_default_policy = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.957204 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.pbm_enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.957595 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.pbm_wsdl_location = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.959213 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.959621 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.serial_port_proxy_uri = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.960008 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.serial_port_service_uri = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.960429 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.task_poll_interval = 0.5 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.960825 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.use_linked_clone = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.961228 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.vnc_keymap = en-us {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.961644 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.vnc_port = 5900 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.962032 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vmware.vnc_port_total = 10000 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.962501 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.auth_schemes = ['none'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.962895 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.enabled = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.963550 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.963955 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.964678 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.novncproxy_port = 6080 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.965251 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.server_listen = 127.0.0.1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.965663 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.966046 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.vencrypt_ca_certs = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.966430 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.vencrypt_client_cert = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.966808 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] vnc.vencrypt_client_key = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.967280 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.967675 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.968525 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.969079 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.969637 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.disable_rootwrap = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.970035 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.enable_numa_live_migration = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.970425 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.970824 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.971239 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.971630 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.libvirt_disable_apic = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.972019 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.972406 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.972793 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.973181 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.973582 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.974112 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.974560 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.client_socket_timeout = 900 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.975033 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.default_pool_size = 1000 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.975370 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.keep_alive = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.975779 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.max_header_line = 16384 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.976174 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.secure_proxy_ssl_header = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.976563 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.ssl_ca_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.976947 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.ssl_cert_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.977327 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.ssl_key_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.977719 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.tcp_keepidle = 600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.978194 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.978525 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] zvm.ca_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.978902 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] zvm.cloud_connector_url = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.979434 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.979829 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] zvm.reachable_timeout = 300 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.980276 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.enforce_new_defaults = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.980671 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.enforce_scope = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.981093 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.policy_default_rule = default {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.981541 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.981945 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.policy_file = policy.yaml {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.982388 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.982790 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.983205 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.983614 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.984007 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.984439 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.984867 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.985478 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.connection_string = messaging:// {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.985877 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.enabled = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.986302 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.es_doc_type = notification {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.986710 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.es_scroll_size = 10000 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.987138 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.es_scroll_time = 2m {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.987531 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.filter_error_trace = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.987938 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.hmac_keys = SECRET_KEY {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.988335 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.sentinel_service_name = mymaster {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.988747 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.socket_timeout = 0.1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.992632 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] profiler.trace_sqlalchemy = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.992632 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] remote_debug.host = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.992632 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] remote_debug.port = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.992632 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.992632 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.992632 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.993062 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.993062 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.993062 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.993062 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.993336 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.993525 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.994062 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.994620 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.995197 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.995610 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.996034 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.996395 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.996809 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.997196 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.997586 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.997983 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.998404 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.998790 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.999227 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.999596 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:57:59.999986 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.000378 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.000923 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.ssl = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.001328 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.001729 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.002117 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.002520 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.002921 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.003399 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.003807 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_notifications.retry = -1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.004387 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.004799 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.005834 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.auth_section = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.006223 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.auth_type = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.006605 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.cafile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.006985 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.certfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.007394 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.collect_timing = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.007773 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.connect_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.008155 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.connect_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.008550 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.endpoint_id = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.008929 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.endpoint_override = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.009312 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.insecure = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.009785 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.keyfile = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.010185 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.max_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.010565 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.min_version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.010952 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.region_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.011390 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.service_name = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.011791 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.service_type = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.012153 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.split_loggers = False {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.012533 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.status_code_retries = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.012915 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.status_code_retry_delay = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.013293 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.timeout = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.013678 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.valid_interfaces = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.014053 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_limit.version = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.014666 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_reports.file_event_handler = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.015084 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.015494 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] oslo_reports.log_dir = None {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:58:00.021645 ncdv-master-1 nova-conductor[128929]: DEBUG oslo_service.service [None req-ecbebff8-dcff-41af-91f8-fdf14dac24d9 None None] ******************************************************************************** {{(pid=128929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 16 20:58:09.352882 ncdv-master-1 nova-conductor[128929]: DEBUG dbcounter [-] [128929] Writing DB stats nova_api:SELECT=3 {{(pid=128929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:09.516337 ncdv-master-1 nova-conductor[128929]: DEBUG dbcounter [-] [128929] Writing DB stats nova_cell1:SELECT=3 {{(pid=128929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:09.524515 ncdv-master-1 nova-conductor[128929]: DEBUG dbcounter [-] [128929] Writing DB stats nova_cell0:SELECT=3 {{(pid=128929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:34.806441 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:INSERT=1,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:34.869212 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=16,nova_cell0:INSERT=1,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:14.806375 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:14.867666 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:54.805639 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:54.867358 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:34.807676 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:34.862490 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:01:04.807914 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:01:14.866710 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:01:44.816294 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:01:54.864966 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:24.818317 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:34.864109 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:44.827154 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:54.872956 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:03:24.834231 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:03:34.878103 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:04:04.834413 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:04:14.867645 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:04:44.825072 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:04:54.871084 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:05:24.832668 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:05:34.871884 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:06:04.834510 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:06:14.871379 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:06:44.831921 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:06:54.874560 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:04.839745 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:34.880863 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:44.840233 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:12.620901 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_db.sqlalchemy.engines [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Parent process 128929 forked (129815) with an open database connection, which is being discarded and recreated. {{(pid=129815) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Jul 16 21:08:12.630900 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writer thread running {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 21:08:12.637920 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:14.168498 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Took 1.51 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:08:14.229392 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:14.229392 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:14.234621 ncdv-master-1 nova-conductor[129815]: INFO dbcounter [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Registered counter for database nova_cell1 Jul 16 21:08:14.252400 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_db.sqlalchemy.engines [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 21:08:14.259427 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writer thread running {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 21:08:14.813936 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:14.817125 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:14.818368 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:14.818919 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:14.821293 ncdv-master-1 nova-conductor[129815]: INFO dbcounter [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Registered counter for database nova_cell0 Jul 16 21:08:14.852512 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_db.sqlalchemy.engines [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 21:08:14.870555 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writer thread running {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 21:08:14.886553 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:14.914650 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Getting quotas for project e7c343c974bd4ec0a6a765f818b895be. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:08:14.922575 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Getting quotas for user db6c21ea09c54ea492d806f42d2f69a7 and project e7c343c974bd4ec0a6a765f818b895be. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:08:14.961060 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] [instance: 7895aae7-b50f-48cf-a3e1-5b33dc6e16a3] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:08:14.965128 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:14.965856 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:15.085217 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] [instance: 7895aae7-b50f-48cf-a3e1-5b33dc6e16a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:08:15.089731 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:15.090366 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:15.458325 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:15.458996 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:15.470806 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6afadc81-b54d-4480-baad-48637e02b8c4 tempest-AggregatesAdminTestJSON-412945753 tempest-AggregatesAdminTestJSON-412945753-project] Acquired lock "compute-rpcapi-router" {{(pid=129815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 16 21:08:15.473929 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2ab11d72-f801-4ba3-b2f8-ea166cea9bed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:15.474522 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2ab11d72-f801-4ba3-b2f8-ea166cea9bed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:15.475499 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2ab11d72-f801-4ba3-b2f8-ea166cea9bed None None] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:15.476058 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2ab11d72-f801-4ba3-b2f8-ea166cea9bed None None] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:15.489856 ncdv-master-1 nova-conductor[129815]: INFO nova.compute.rpcapi [None req-2ab11d72-f801-4ba3-b2f8-ea166cea9bed None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 16 21:08:15.491119 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2ab11d72-f801-4ba3-b2f8-ea166cea9bed None None] Releasing lock "compute-rpcapi-router" {{(pid=129815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 16 21:08:24.846196 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:25.267190 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:25.349437 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:25.490384 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:25.492981 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=15,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=19,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:39.055564 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_db.sqlalchemy.engines [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Parent process 128929 forked (129816) with an open database connection, which is being discarded and recreated. {{(pid=129816) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Jul 16 21:08:39.070925 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writer thread running {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 21:08:39.083864 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:40.387473 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Took 1.30 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:08:40.477230 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:40.481518 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:40.494598 ncdv-master-1 nova-conductor[129816]: INFO dbcounter [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Registered counter for database nova_cell1 Jul 16 21:08:40.508811 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_db.sqlalchemy.engines [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 21:08:40.528556 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writer thread running {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 21:08:40.920580 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:40.928219 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:40.929478 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:40.931277 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:40.936554 ncdv-master-1 nova-conductor[129816]: INFO dbcounter [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Registered counter for database nova_cell0 Jul 16 21:08:40.990175 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_db.sqlalchemy.engines [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 21:08:41.000858 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writer thread running {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 21:08:41.043416 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Getting quotas for project 55a19b7a4682457a9132f5fc80110712. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:08:41.069062 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Getting quotas for user a9b68dacc4b8463ba07fae6372131117 and project 55a19b7a4682457a9132f5fc80110712. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:08:41.090840 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: 1703f309-9e2e-4c5f-8588-eb4e43f21d91] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:08:41.090840 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:41.090840 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:41.184300 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: 1703f309-9e2e-4c5f-8588-eb4e43f21d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:08:41.189133 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:41.190530 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:41.559964 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:41.560646 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:41.560970 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-b71b-4fee-a929-ebac16efc9a0 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Acquired lock "compute-rpcapi-router" {{(pid=129816) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 16 21:08:41.562004 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d19fa2e4-5fc7-4ca0-aaef-508850e4afcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:41.563444 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d19fa2e4-5fc7-4ca0-aaef-508850e4afcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:41.563444 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d19fa2e4-5fc7-4ca0-aaef-508850e4afcc None None] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:41.563622 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d19fa2e4-5fc7-4ca0-aaef-508850e4afcc None None] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:41.582655 ncdv-master-1 nova-conductor[129816]: INFO nova.compute.rpcapi [None req-d19fa2e4-5fc7-4ca0-aaef-508850e4afcc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 16 21:08:41.583882 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d19fa2e4-5fc7-4ca0-aaef-508850e4afcc None None] Releasing lock "compute-rpcapi-router" {{(pid=129816) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 16 21:08:51.395580 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:51.488337 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:51.580606 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:51.582537 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=12,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:54.884433 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:56.969100 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:08:57.053217 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:57.053636 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:57.494693 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:57.497600 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:57.498617 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:57.501754 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:57.503314 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:57.573320 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Getting quotas for project d0ee02e4c8b448f2b77798ae504129b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:08:57.586400 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Getting quotas for user ef9cbce2b2e64665b7f50767342dcb46 and project d0ee02e4c8b448f2b77798ae504129b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:08:57.612441 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] [instance: e506a6e0-fbcd-4e53-a6a0-d31761654c92] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:08:57.614550 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:57.615262 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:57.716172 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] [instance: e506a6e0-fbcd-4e53-a6a0-d31761654c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:08:57.721079 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:57.721079 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:08:58.065758 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:08:58.067230 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-da17a894-f6cc-40d3-8dd1-cc9c492315f8 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:07.538330 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:07.725496 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:07.857208 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:07.980016 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:10.525043 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:10.593372 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:10.593795 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:11.100610 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:11.101442 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:11.102958 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:11.103598 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:11.146047 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:11.154197 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for user abeb7020019d41a18de42956d706a011 and project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:11.174326 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 148d5ad9-2900-4c2b-909b-aa446757e33d] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:11.175670 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:11.176574 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:11.311808 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 148d5ad9-2900-4c2b-909b-aa446757e33d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:11.312485 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:11.314903 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:11.359124 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c74223c5-88f1-4095-b044-c0667906b49f tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:09:11.368955 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c74223c5-88f1-4095-b044-c0667906b49f tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:11.368955 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c74223c5-88f1-4095-b044-c0667906b49f tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:11.680236 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:11.680236 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-74461de9-8874-4272-be59-ea255f3c7308 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:12.029019 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:12.057324 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:12.057976 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:12.152271 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-c74223c5-88f1-4095-b044-c0667906b49f tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] [instance: 1703f309-9e2e-4c5f-8588-eb4e43f21d91] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 21:09:12.376692 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:12.379478 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:12.381042 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:12.382301 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:12.411352 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Getting quotas for project fc1c3463f9444119af9d18f85bdd703d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:12.421630 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Getting quotas for user 0d72626f465b4f37ad3b18bb945d4000 and project fc1c3463f9444119af9d18f85bdd703d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:12.447131 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] [instance: 1631f0cc-de67-4c0d-abd0-3e0e11dfb4ed] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:12.448945 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:12.449522 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:12.525200 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] [instance: 1631f0cc-de67-4c0d-abd0-3e0e11dfb4ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:12.527517 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:12.528094 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:12.903602 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:12.903602 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-eda8b57f-3425-4f14-80eb-3b55de7fa22a tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:13.545258 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-c74223c5-88f1-4095-b044-c0667906b49f tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] Created allocations for migration 89e5d5d2-96d7-41cd-bb92-00da649cf739 on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:09:14.890174 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-c74223c5-88f1-4095-b044-c0667906b49f tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] [instance: 1703f309-9e2e-4c5f-8588-eb4e43f21d91] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 21:09:21.127242 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:22.142783 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:22.395070 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:22.534648 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:22.624429 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:22.777088 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:24.969350 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:25.233820 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=24,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=21,nova_cell1:RELEASE=1,nova_cell1:UPDATE=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:28.895967 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:28.937411 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:28.938031 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:29.202741 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:29.203625 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:29.204566 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:29.210062 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:29.275371 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Getting quotas for project 9b769bf8f3ea4e368bf68de1df6538f9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:29.291135 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Getting quotas for user 6a69f9dee03d43beaafa966216b9e289 and project 9b769bf8f3ea4e368bf68de1df6538f9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:29.308189 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] [instance: c40ba20d-eb88-4ee8-be8f-ecbbd3315c48] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:29.315476 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:29.316405 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:29.381443 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] [instance: c40ba20d-eb88-4ee8-be8f-ecbbd3315c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:29.382999 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:29.383465 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:29.715638 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:29.716057 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bce5701-bb46-4fcc-b437-3da0d2d2a152 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:31.229700 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:31.274157 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:31.275084 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:31.538276 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:31.548016 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:31.548545 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:31.549850 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:31.550374 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:31.571746 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Getting quotas for project fb6deae6b08e4ed8b15dc6edfe1d38d3. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:31.577586 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Getting quotas for user ba60685a2001459cbfb531d95a6b296e and project fb6deae6b08e4ed8b15dc6edfe1d38d3. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:31.589720 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] [instance: cf53f7cd-deae-4b34-bf8e-3afef98b2ec6] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:31.590728 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:31.591264 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:31.756066 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] [instance: cf53f7cd-deae-4b34-bf8e-3afef98b2ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:31.756066 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:31.756066 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:32.106064 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:32.106644 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-0bedb7e1-9b54-4603-bdce-6c1995fc7553 tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:33.352317 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:33.352914 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:33.429091 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:34.381084 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Took 0.95 seconds to select destinations for 2 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:34.419261 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:34.419683 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:34.611439 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:34.612824 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:34.775592 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:34.776813 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:34.778923 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:34.779589 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:34.804869 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:34.808253 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for user abeb7020019d41a18de42956d706a011 and project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:34.832651 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 45164bce-7acf-4ef6-8afa-aaab6287ecf4] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:34.833729 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:34.834838 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:34.896081 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 45164bce-7acf-4ef6-8afa-aaab6287ecf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:34.897561 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:34.898000 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:35.253098 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:35.253547 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:35.263604 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 944f68af-bf99-428f-9357-9ce9f807483b] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:35.264123 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance_group [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lazy-loading 'hosts' on InstanceGroup uuid 73f6bd9e-6a32-47fd-a7a1-a896ecc028e4 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:362}} Jul 16 21:09:35.273968 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:35.274745 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:35.330140 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 944f68af-bf99-428f-9357-9ce9f807483b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:35.331418 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:35.331837 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:35.668484 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:35.669192 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-57f86eb7-5a91-4648-868e-91a5a0109834 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:36.166969 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:36.190240 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:36.190647 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:36.371786 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:36.373056 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:36.374763 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:36.375508 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:36.405656 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Getting quotas for project fc1c3463f9444119af9d18f85bdd703d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:36.412746 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Getting quotas for user 0d72626f465b4f37ad3b18bb945d4000 and project fc1c3463f9444119af9d18f85bdd703d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:36.428326 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] [instance: 67266541-b43e-414c-a744-9c32c6f53975] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:36.429506 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:36.429920 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:36.590024 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] [instance: 67266541-b43e-414c-a744-9c32c6f53975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:36.591402 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:36.592014 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:36.933886 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:36.934653 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a888bbf6-a83b-4857-8e5f-8001525449a5 tempest-LiveMigrationNegativeTest-742579909 tempest-LiveMigrationNegativeTest-742579909-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:38.638928 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f4b7c98b-23de-4751-81c9-56b9c8a5715b tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:09:38.652826 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f4b7c98b-23de-4751-81c9-56b9c8a5715b tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:38.653260 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f4b7c98b-23de-4751-81c9-56b9c8a5715b tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:38.812400 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f4b7c98b-23de-4751-81c9-56b9c8a5715b tempest-ServersAdmin275Test-319972257 tempest-ServersAdmin275Test-319972257-project] [instance: cf53f7cd-deae-4b34-bf8e-3afef98b2ec6] No migration record for the rebuild/evacuate request. {{(pid=129815) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:09:44.791407 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:46.392590 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:46.598571 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=35,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:46.703846 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:46.835563 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:47.553144 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ffa6b6ef-d1fd-4587-9b63-a6d2bfa0c508 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:09:47.553688 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ffa6b6ef-d1fd-4587-9b63-a6d2bfa0c508 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:47.554143 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ffa6b6ef-d1fd-4587-9b63-a6d2bfa0c508 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:48.434352 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-ffa6b6ef-d1fd-4587-9b63-a6d2bfa0c508 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Created allocations for migration 1c7aed24-88ed-4781-9f31-aaffe8cb728e on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:09:48.636263 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:48.867112 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:48.905427 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=32,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=53,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:49.210432 ncdv-master-1 nova-conductor[129816]: DEBUG nova.scheduler.utils [None req-ffa6b6ef-d1fd-4587-9b63-a6d2bfa0c508 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] [instance: c40ba20d-eb88-4ee8-be8f-ecbbd3315c48] Instance allocations successfully created on destination node c18c7b31-cb52-43e0-ba1f-41c40f4e73e5: {'allocations': {'c18c7b31-cb52-43e0-ba1f-41c40f4e73e5': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=129816) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Jul 16 21:09:49.210432 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-ffa6b6ef-d1fd-4587-9b63-a6d2bfa0c508 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lazy-loading 'resources' on Instance uuid c40ba20d-eb88-4ee8-be8f-ecbbd3315c48 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:09:49.215461 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-ffa6b6ef-d1fd-4587-9b63-a6d2bfa0c508 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lazy-loading 'pci_requests' on Instance uuid c40ba20d-eb88-4ee8-be8f-ecbbd3315c48 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:09:51.385787 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.live_migrate [None req-ffa6b6ef-d1fd-4587-9b63-a6d2bfa0c508 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] [instance: c40ba20d-eb88-4ee8-be8f-ecbbd3315c48] Start binding ports on destination host: nch2-master-1 {{(pid=129816) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:09:54.243090 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:54.300075 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:54.300711 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:54.430826 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:54.431676 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:54.432641 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:54.433279 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:54.452387 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Getting quotas for project 55a19b7a4682457a9132f5fc80110712. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:54.460226 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Getting quotas for user a9b68dacc4b8463ba07fae6372131117 and project 55a19b7a4682457a9132f5fc80110712. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:54.474787 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: f98a9762-a67c-4e95-85b8-727c81bdb03a] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:54.488003 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:54.488401 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:54.559955 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: f98a9762-a67c-4e95-85b8-727c81bdb03a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:54.561564 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:54.561913 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:54.689036 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:54.711276 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:54.711632 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:54.856668 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:54.857102 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-215ed8c7-4911-47de-87b7-c84e69aefcc2 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:54.993530 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:54.996834 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:54.998067 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:55.012580 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:55.081239 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Getting quotas for project 5f9cdca4179c4875a4be57cf8a9f46a8. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:55.089964 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Getting quotas for user 9c428093bcf445a6aea6ddb209e6e5cf and project 5f9cdca4179c4875a4be57cf8a9f46a8. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:55.119486 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] [instance: 1e4229cb-4ed9-48c3-b723-28619ae7045c] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:55.119486 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:55.119486 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:55.200362 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] [instance: 1e4229cb-4ed9-48c3-b723-28619ae7045c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:55.203171 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:55.207796 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:55.474201 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:55.474839 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f801024b-7375-4ac8-928b-3dd404f7467a tempest-ServerDiagnosticsNegativeTest-1844467799 tempest-ServerDiagnosticsNegativeTest-1844467799-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:57.883077 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:57.883077 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.005294 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Took 1.04 seconds to select destinations for 2 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:09:59.029683 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.030181 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.162749 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.163517 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.303960 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.304379 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.306483 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.306483 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.323570 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:09:59.328144 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for user abeb7020019d41a18de42956d706a011 and project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:09:59.340840 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 84ee8179-ff94-43b3-97f2-1867bc6420a8] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:59.341829 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.342239 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.426313 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 84ee8179-ff94-43b3-97f2-1867bc6420a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:59.431706 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.432646 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.707999 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.708666 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.720085 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 7d624313-0c12-4da2-a95c-3903efae7608] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:09:59.720943 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance_group [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lazy-loading 'hosts' on InstanceGroup uuid d6276585-4df3-40a1-817c-e7dcc6987bf4 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:362}} Jul 16 21:09:59.729763 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.730182 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:09:59.803638 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 7d624313-0c12-4da2-a95c-3903efae7608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:09:59.805572 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:09:59.806303 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:00.143544 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:00.143544 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5449a5c-dcec-4669-be4e-39cdfd3aacb8 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:01.033038 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:10:01.057611 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:01.058026 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:01.236227 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:01.237027 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:01.238015 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:01.238795 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:01.260820 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Getting quotas for project d0ee02e4c8b448f2b77798ae504129b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:10:01.266937 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Getting quotas for user ef9cbce2b2e64665b7f50767342dcb46 and project d0ee02e4c8b448f2b77798ae504129b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:10:01.280285 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] [instance: 8872e8cf-593e-4a7a-940d-e0c8159d4ad7] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:10:01.281965 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:01.282623 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:01.382437 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] [instance: 8872e8cf-593e-4a7a-940d-e0c8159d4ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:10:01.384004 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:01.384425 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:01.495646 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:01.496162 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:01.840525 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:01.843342 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-689452c4-4592-4824-aeab-36fd328608f9 tempest-ServersWithSpecificFlavorTestJSON-1854487373 tempest-ServersWithSpecificFlavorTestJSON-1854487373-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:04.882221 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=30,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:09.313786 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:09.812084 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=51 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:09.904009 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:10.007337 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:11.246221 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:11.500671 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=38,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:11.635732 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:10:11.660005 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:11.660891 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:11.730803 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:11.732142 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:11.910755 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=34,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:11.915822 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-79334ea7-3699-4cd7-83c0-9a65abc0af45 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:10:11.916648 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-79334ea7-3699-4cd7-83c0-9a65abc0af45 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:11.917357 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-79334ea7-3699-4cd7-83c0-9a65abc0af45 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:11.919657 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:11.920717 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:11.925398 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:11.926017 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:11.952298 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Getting quotas for project 9b769bf8f3ea4e368bf68de1df6538f9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:10:11.957484 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Getting quotas for user 6a69f9dee03d43beaafa966216b9e289 and project 9b769bf8f3ea4e368bf68de1df6538f9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:10:11.968859 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] [instance: 4ee3ffbe-c16a-4847-a343-469c645e4b25] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:10:11.974591 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:11.974591 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:12.095742 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] [instance: 4ee3ffbe-c16a-4847-a343-469c645e4b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:10:12.095742 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:12.095742 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:12.284682 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-79334ea7-3699-4cd7-83c0-9a65abc0af45 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: f98a9762-a67c-4e95-85b8-727c81bdb03a] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 21:10:12.440096 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:12.440557 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6b6d19d8-5eb9-4021-9158-2f3ebe7a5323 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:13.161159 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-79334ea7-3699-4cd7-83c0-9a65abc0af45 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Created allocations for migration e071bf21-965c-430b-8813-13ba0b459d53 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:10:13.956106 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-79334ea7-3699-4cd7-83c0-9a65abc0af45 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: f98a9762-a67c-4e95-85b8-727c81bdb03a] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [Selection(allocation_request='{"allocations": {"c18c7b31-cb52-43e0-ba1f-41c40f4e73e5": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c18c7b31-cb52-43e0-ba1f-41c40f4e73e5"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=c18c7b31-cb52-43e0-ba1f-41c40f4e73e5,limits=SchedulerLimits,nodename='nch2-master-1',service_host='nch2-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 21:10:17.696019 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-2df1772f-fe29-4d5c-a08e-76d985b5efa8 tempest-ServersAdmin275Test-1451915950 tempest-ServersAdmin275Test-1451915950-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:10:17.696545 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2df1772f-fe29-4d5c-a08e-76d985b5efa8 tempest-ServersAdmin275Test-1451915950 tempest-ServersAdmin275Test-1451915950-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:17.696956 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2df1772f-fe29-4d5c-a08e-76d985b5efa8 tempest-ServersAdmin275Test-1451915950 tempest-ServersAdmin275Test-1451915950-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:17.821015 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-2df1772f-fe29-4d5c-a08e-76d985b5efa8 tempest-ServersAdmin275Test-1451915950 tempest-ServersAdmin275Test-1451915950-project-admin] [instance: cf53f7cd-deae-4b34-bf8e-3afef98b2ec6] No migration record for the rebuild/evacuate request. {{(pid=129815) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:10:21.944390 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:26.054463 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:10:26.091675 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:26.092491 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:26.241081 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:26.241870 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:26.248106 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:26.248926 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:26.293712 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:10:26.306962 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for user abeb7020019d41a18de42956d706a011 and project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:10:26.337217 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: b941b324-a54d-446f-bf92-570a80ba2152] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:10:26.338696 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:26.339400 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:26.477197 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: b941b324-a54d-446f-bf92-570a80ba2152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:10:26.481097 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:26.485084 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:26.915454 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:26.915454 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ea39fe49-e970-4ea0-9d4f-55739157f6f9 tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:27.695717 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:27.830530 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:27.866861 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=18,nova_cell1:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:36.268398 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:36.492029 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=6,nova_cell1:INSERT=20 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:36.585154 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:36.762107 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:41.241606 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a6bf0c92-2907-4f4e-9560-5d5f6b92d7db tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:10:41.242128 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a6bf0c92-2907-4f4e-9560-5d5f6b92d7db tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:41.242529 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a6bf0c92-2907-4f4e-9560-5d5f6b92d7db tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:42.205471 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-a6bf0c92-2907-4f4e-9560-5d5f6b92d7db tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Created allocations for migration 10021c90-7d58-4c9e-87a0-c55862383c50 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129815) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:10:42.713807 ncdv-master-1 nova-conductor[129815]: DEBUG nova.scheduler.utils [None req-a6bf0c92-2907-4f4e-9560-5d5f6b92d7db tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] [instance: 4ee3ffbe-c16a-4847-a343-469c645e4b25] Instance allocations successfully created on destination node c18c7b31-cb52-43e0-ba1f-41c40f4e73e5: {'allocations': {'c18c7b31-cb52-43e0-ba1f-41c40f4e73e5': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=129815) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Jul 16 21:10:42.714400 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-a6bf0c92-2907-4f4e-9560-5d5f6b92d7db tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lazy-loading 'resources' on Instance uuid 4ee3ffbe-c16a-4847-a343-469c645e4b25 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:10:42.722128 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-a6bf0c92-2907-4f4e-9560-5d5f6b92d7db tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lazy-loading 'pci_requests' on Instance uuid 4ee3ffbe-c16a-4847-a343-469c645e4b25 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:10:43.787248 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:10:43.844858 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:43.846307 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:44.149550 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:44.151135 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:44.151547 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:44.152276 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:44.152668 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:44.180429 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Getting quotas for project d9b92fc544c544f686ac2ab7ff5123b6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:10:44.187172 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Getting quotas for user 578b87f863b34f57a571f7e56d44f118 and project d9b92fc544c544f686ac2ab7ff5123b6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:10:44.200957 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] [instance: de210dbd-1398-413f-9a0f-63cae300bd03] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:10:44.200957 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:44.201366 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:44.287745 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] [instance: de210dbd-1398-413f-9a0f-63cae300bd03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:10:44.289359 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:44.289836 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:44.410537 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.live_migrate [None req-a6bf0c92-2907-4f4e-9560-5d5f6b92d7db tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] [instance: 4ee3ffbe-c16a-4847-a343-469c645e4b25] Start binding ports on destination host: nch2-master-1 {{(pid=129815) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:10:44.552753 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:44.553163 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ad46f899-d715-409e-9ef0-dcd620a84c1a tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:48.353864 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:10:48.388234 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:48.389464 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:48.540483 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:48.547221 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:48.547993 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:48.548998 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:48.549560 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:48.576922 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:10:48.583643 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for user abeb7020019d41a18de42956d706a011 and project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:10:48.600432 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: a4a0aaec-dc64-400c-b3f0-ec61fa740b8d] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:10:48.602358 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:48.603212 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:48.769092 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: a4a0aaec-dc64-400c-b3f0-ec61fa740b8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:10:48.771001 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:48.772317 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:49.034690 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:10:49.038060 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5d93270f-8059-4cc4-a57e-753e6539efcf tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:10:54.165956 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:54.297920 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:54.408307 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:54.486996 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:58.561501 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:58.777502 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=19 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:58.890902 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:58.972080 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:04.844777 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:05.105157 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-1460fa34-cee5-46bc-bd33-8ff913362ad5 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:11:05.105741 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1460fa34-cee5-46bc-bd33-8ff913362ad5 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:05.106058 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1460fa34-cee5-46bc-bd33-8ff913362ad5 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:06.284380 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-1460fa34-cee5-46bc-bd33-8ff913362ad5 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Created allocations for migration bdbd71d5-a5b5-41aa-b67c-7f907e23c3c9 on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:11:06.784879 ncdv-master-1 nova-conductor[129816]: DEBUG nova.scheduler.utils [None req-1460fa34-cee5-46bc-bd33-8ff913362ad5 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] [instance: de210dbd-1398-413f-9a0f-63cae300bd03] Instance allocations successfully created on destination node fcc75857-7dde-4ac0-88e4-871d39001997: {'allocations': {'fcc75857-7dde-4ac0-88e4-871d39001997': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=129816) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Jul 16 21:11:06.785367 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-1460fa34-cee5-46bc-bd33-8ff913362ad5 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lazy-loading 'resources' on Instance uuid de210dbd-1398-413f-9a0f-63cae300bd03 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:11:06.790322 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-1460fa34-cee5-46bc-bd33-8ff913362ad5 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lazy-loading 'pci_requests' on Instance uuid de210dbd-1398-413f-9a0f-63cae300bd03 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:11:07.281193 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Took 1.08 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:11:07.307591 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:07.308151 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:07.493110 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:07.493827 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:07.495527 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:07.496532 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:07.524585 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Getting quotas for project 55a19b7a4682457a9132f5fc80110712. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:11:07.530793 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Getting quotas for user a9b68dacc4b8463ba07fae6372131117 and project 55a19b7a4682457a9132f5fc80110712. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:11:07.543412 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: a7a6fe88-6ffc-40f8-9fae-f00f91a91ac2] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:11:07.544737 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:07.545542 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:07.619373 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: a7a6fe88-6ffc-40f8-9fae-f00f91a91ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:11:07.622705 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:07.623859 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:07.873141 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:07.873593 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b797902d-805b-4acf-b637-51745e351450 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:07.922883 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.live_migrate [None req-1460fa34-cee5-46bc-bd33-8ff913362ad5 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] [instance: de210dbd-1398-413f-9a0f-63cae300bd03] Start binding ports on destination host: nch1-master-1 {{(pid=129816) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:11:10.157897 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:11:10.206146 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:10.206557 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:10.422166 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:10.422992 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:10.424026 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:10.424636 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:10.461437 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Getting quotas for project 9b769bf8f3ea4e368bf68de1df6538f9. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:11:10.467770 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Getting quotas for user 6a69f9dee03d43beaafa966216b9e289 and project 9b769bf8f3ea4e368bf68de1df6538f9. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:11:10.481074 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] [instance: 6a391156-ffce-49c0-a79d-47b4544264f5] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:11:10.483372 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:10.484016 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:10.567926 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] [instance: 6a391156-ffce-49c0-a79d-47b4544264f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:11:10.569763 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:10.570478 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:11.003595 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:11.004256 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-a70561ba-1ebb-46dd-8a43-c5b6f1fb2411 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:13.169774 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:11:13.218314 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:13.218964 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:13.416474 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:13.417868 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:13.422203 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:13.422906 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:13.459540 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:11:13.467410 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Getting quotas for user abeb7020019d41a18de42956d706a011 and project 649babe54d104436af461f1ee4767001. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:11:13.483273 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 65a70cca-b978-41ab-b890-6052f653c5c3] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:11:13.484578 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:13.485801 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:13.567937 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] [instance: 65a70cca-b978-41ab-b890-6052f653c5c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:11:13.570414 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:13.571890 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:13.912415 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:13.912982 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-02791a17-aaf2-442d-b226-de65ffa96eac tempest-ServersOnMultiNodesTest-1258903790 tempest-ServersOnMultiNodesTest-1258903790-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:20.450966 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:20.575714 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=19 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:20.695241 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=18 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:20.777255 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:23.451469 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:23.582705 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=34 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:23.701439 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:23.815358 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:24.893470 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=19,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:26.385416 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:11:26.432393 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:26.432807 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:26.682945 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:26.683444 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:26.684620 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:26.685261 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:26.713189 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Getting quotas for project 30d028fa9b854c8fb71c8cbed2985c27. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:11:26.723417 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Getting quotas for user 52281b3989a04ca2a50b0bc93bf783f0 and project 30d028fa9b854c8fb71c8cbed2985c27. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:11:26.745430 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] [instance: b07f0d53-2cd4-440f-be47-077703aa66e6] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:11:26.747103 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:26.747700 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:26.904843 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] [instance: b07f0d53-2cd4-440f-be47-077703aa66e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:11:26.907738 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:26.908663 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:27.281576 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:27.282164 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1c0d2890-8ff7-4cb0-99a9-685d268a5efa tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:30.684755 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5dbbdeaa-24e3-4f91-923e-a8e4da172ccb tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:11:30.688339 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5dbbdeaa-24e3-4f91-923e-a8e4da172ccb tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:30.693127 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5dbbdeaa-24e3-4f91-923e-a8e4da172ccb tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:31.410609 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-5dbbdeaa-24e3-4f91-923e-a8e4da172ccb tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: a7a6fe88-6ffc-40f8-9fae-f00f91a91ac2] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129815) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 21:11:32.278978 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-5dbbdeaa-24e3-4f91-923e-a8e4da172ccb tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Created allocations for migration 8a6b9c06-f243-4e3a-9b29-bcae7fd4f883 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129815) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:11:32.987423 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:11:33.092456 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:33.092875 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:33.196597 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-5dbbdeaa-24e3-4f91-923e-a8e4da172ccb tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: a7a6fe88-6ffc-40f8-9fae-f00f91a91ac2] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"fcc75857-7dde-4ac0-88e4-871d39001997": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fcc75857-7dde-4ac0-88e4-871d39001997"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=fcc75857-7dde-4ac0-88e4-871d39001997,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=129815) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 21:11:33.331930 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:33.334375 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:33.335418 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:33.339104 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:33.386128 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Getting quotas for project d9b92fc544c544f686ac2ab7ff5123b6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:11:33.392268 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Getting quotas for user 578b87f863b34f57a571f7e56d44f118 and project d9b92fc544c544f686ac2ab7ff5123b6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:11:33.416806 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] [instance: 0fb5b5b6-1796-4406-b276-326e1d7dd451] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:11:33.434848 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:33.435305 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:33.509843 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] [instance: 0fb5b5b6-1796-4406-b276-326e1d7dd451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:11:33.514626 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:33.515074 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:33.925474 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:33.925886 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee23-7f4c-4780-acd0-0237d56fe0c6 tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:41.371801 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:11:41.468218 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:41.468218 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:41.815270 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=21,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:41.836765 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:41.837214 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:41.838863 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:41.843729 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:41.912437 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Getting quotas for project cda86413e74b4c1e8e09bd4df4926664. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:11:41.920994 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Getting quotas for user 2dfcad8d2b57481bb33aa8f5d7483c51 and project cda86413e74b4c1e8e09bd4df4926664. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:11:41.942397 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] [instance: 8020f553-6025-4f19-835c-c00e2fb4f764] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:11:41.943989 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:41.945968 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:42.053246 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] [instance: 8020f553-6025-4f19-835c-c00e2fb4f764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:11:42.060680 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:42.060680 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:42.439526 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:42.440236 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-73dd7b55-afc6-48f5-82a0-67fafd996bd9 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:43.365885 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:43.519201 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=35,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:43.829521 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:43.831547 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:51.879927 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:52.064825 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=6,nova_cell1:INSERT=21,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:52.252450 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:52.311664 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:11:52.342579 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:52.348333 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:52.365824 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:52.669925 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:52.670413 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:52.676212 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:52.676212 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:52.692262 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Getting quotas for project fb4ff5d7e42940cdb7be71dadd895ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:11:52.712159 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Getting quotas for user 034c11cc3f174c6fb44c8d64e55cf8b9 and project fb4ff5d7e42940cdb7be71dadd895ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:11:52.730621 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] [instance: 2b26717b-355f-417e-8a7c-72c41e1974e1] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:11:52.736392 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:52.736392 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:52.834959 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] [instance: 2b26717b-355f-417e-8a7c-72c41e1974e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:11:52.836734 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:52.840847 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:53.091691 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:53.091691 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7a5306f5-59cc-4354-bf2d-c4b779b8b7ba tempest-ServersTestJSON-27104667 tempest-ServersTestJSON-27104667-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:58.038668 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-d4be49b0-3f0f-4bd9-8322-ddb3009f8a78 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:11:58.041462 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d4be49b0-3f0f-4bd9-8322-ddb3009f8a78 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:11:58.042699 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d4be49b0-3f0f-4bd9-8322-ddb3009f8a78 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:11:59.142165 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-d4be49b0-3f0f-4bd9-8322-ddb3009f8a78 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Created allocations for migration 9dbec7d9-5cec-479e-9806-7fe17eae3b65 on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129815) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:11:59.461699 ncdv-master-1 nova-conductor[129815]: DEBUG nova.scheduler.utils [None req-d4be49b0-3f0f-4bd9-8322-ddb3009f8a78 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] [instance: 0fb5b5b6-1796-4406-b276-326e1d7dd451] Instance allocations successfully created on destination node fcc75857-7dde-4ac0-88e4-871d39001997: {'allocations': {'fcc75857-7dde-4ac0-88e4-871d39001997': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=129815) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Jul 16 21:11:59.461699 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-d4be49b0-3f0f-4bd9-8322-ddb3009f8a78 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lazy-loading 'resources' on Instance uuid 0fb5b5b6-1796-4406-b276-326e1d7dd451 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:11:59.469781 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-d4be49b0-3f0f-4bd9-8322-ddb3009f8a78 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lazy-loading 'pci_requests' on Instance uuid 0fb5b5b6-1796-4406-b276-326e1d7dd451 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:12:00.758500 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.live_migrate [None req-d4be49b0-3f0f-4bd9-8322-ddb3009f8a78 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] [instance: 0fb5b5b6-1796-4406-b276-326e1d7dd451] Start binding ports on destination host: nch1-master-1 {{(pid=129815) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:12:01.266757 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:12:01.289109 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:01.292071 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:01.639341 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:01.644763 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:01.651485 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:01.651485 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:01.651485 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:01.681682 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Getting quotas for project 7d2b583c48254e17a8082f6467f2ae6d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:12:01.688775 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Getting quotas for user 56d4bbcdebc24a34a814d7f6e72fbcfd and project 7d2b583c48254e17a8082f6467f2ae6d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:12:01.705783 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] [instance: 83b1fe77-ef6d-408d-b255-aa3b60aad8f3] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:12:01.716455 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:01.716455 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:01.834795 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] [instance: 83b1fe77-ef6d-408d-b255-aa3b60aad8f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:12:01.836231 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:01.836651 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:02.180676 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:02.181766 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ab27db11-0825-4b9e-8011-fa5ef9692050 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:08.365037 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:12:08.384809 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:08.385778 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:08.576122 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:08.581066 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:08.582117 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:08.582679 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:08.604818 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Getting quotas for project cda86413e74b4c1e8e09bd4df4926664. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:12:08.610934 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Getting quotas for user 2dfcad8d2b57481bb33aa8f5d7483c51 and project cda86413e74b4c1e8e09bd4df4926664. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:12:08.624561 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] [instance: 4ae3e944-b450-40e5-bb71-c02df03212e3] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:12:08.625909 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:08.626502 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:08.721908 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] [instance: 4ae3e944-b450-40e5-bb71-c02df03212e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:12:08.724367 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:08.725749 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:09.007088 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:09.007685 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-af4bcb2b-8cd9-4de0-a7d2-440c4b7a5664 tempest-FloatingIPsAssociationTestJSON-1179742205 tempest-FloatingIPsAssociationTestJSON-1179742205-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:11.657884 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:11.841402 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=37,nova_cell1:RELEASE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:11.943697 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:12.066032 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:14.856373 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=18,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:14.903113 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:18.594555 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:18.734957 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=19 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:18.839577 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:18.912656 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:27.096261 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-12f0ea29-8e29-4687-9c8b-86694dd73ade tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:12:27.096968 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-12f0ea29-8e29-4687-9c8b-86694dd73ade tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:27.097183 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-12f0ea29-8e29-4687-9c8b-86694dd73ade tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:27.329488 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:12:27.387297 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:27.387719 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:27.740279 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:27.741933 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:27.743982 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:27.744742 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:27.779265 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Getting quotas for project d9b92fc544c544f686ac2ab7ff5123b6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:12:27.785689 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Getting quotas for user 578b87f863b34f57a571f7e56d44f118 and project d9b92fc544c544f686ac2ab7ff5123b6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:12:27.799675 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] [instance: 3c5ab09e-0a97-4cfc-b249-a11ab221b5d2] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:12:27.800661 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:27.801135 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:27.891104 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] [instance: 3c5ab09e-0a97-4cfc-b249-a11ab221b5d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:12:27.892702 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:27.893372 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:28.105214 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-12f0ea29-8e29-4687-9c8b-86694dd73ade tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Created allocations for migration dc6c095b-b29c-4cc7-8549-9a760af9983d on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129815) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:12:28.256959 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:28.257370 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-749e1792-6c7e-44f8-8aa7-f09ff990f68c tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:28.401341 ncdv-master-1 nova-conductor[129815]: DEBUG nova.scheduler.utils [None req-12f0ea29-8e29-4687-9c8b-86694dd73ade tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] [instance: 6a391156-ffce-49c0-a79d-47b4544264f5] Instance allocations successfully created on destination node fcc75857-7dde-4ac0-88e4-871d39001997: {'allocations': {'fcc75857-7dde-4ac0-88e4-871d39001997': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=129815) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Jul 16 21:12:28.401341 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-12f0ea29-8e29-4687-9c8b-86694dd73ade tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lazy-loading 'resources' on Instance uuid 6a391156-ffce-49c0-a79d-47b4544264f5 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:12:28.402634 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-12f0ea29-8e29-4687-9c8b-86694dd73ade tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6a391156-ffce-49c0-a79d-47b4544264f5 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:12:28.874887 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:12:28.913116 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:28.913800 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.180042 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.182455 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.183455 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.184121 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.224263 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Getting quotas for project 7d2b583c48254e17a8082f6467f2ae6d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:12:29.233287 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Getting quotas for user 56d4bbcdebc24a34a814d7f6e72fbcfd and project 7d2b583c48254e17a8082f6467f2ae6d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:12:29.251770 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.live_migrate [None req-12f0ea29-8e29-4687-9c8b-86694dd73ade tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] [instance: 6a391156-ffce-49c0-a79d-47b4544264f5] Start binding ports on destination host: nch1-master-1 {{(pid=129815) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:12:29.253589 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] [instance: 74a19091-819b-4cf0-8109-fbb0de65313c] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:12:29.254803 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.256909 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.330798 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] [instance: 74a19091-819b-4cf0-8109-fbb0de65313c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:12:29.332148 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.332544 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.475633 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:12:29.496777 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.497309 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.560837 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.561257 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e980b67f-b20b-4860-8dd4-f1ca64147108 tempest-DeleteServersAdminTestJSON-69305867 tempest-DeleteServersAdminTestJSON-69305867-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.713103 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.713837 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.714595 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.715032 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.733886 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Getting quotas for project 55a19b7a4682457a9132f5fc80110712. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:12:29.738617 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Getting quotas for user a9b68dacc4b8463ba07fae6372131117 and project 55a19b7a4682457a9132f5fc80110712. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:12:29.751537 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: 126f561c-163f-4f6d-8be1-98a2e29b0909] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:12:29.752496 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.752905 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:29.905423 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] [instance: 126f561c-163f-4f6d-8be1-98a2e29b0909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:12:29.906959 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:29.907709 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:30.255478 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:30.256057 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-deb6d2e9-5302-4c66-93a5-462a2b8ecf40 tempest-MigrationsAdminTest-116332175 tempest-MigrationsAdminTest-116332175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:39.196454 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:39.337715 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=34 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:39.457070 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:39.504882 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:39.723036 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:40.045267 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=19 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:40.059554 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:40.180302 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:44.902967 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:12:44.928965 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:44.929612 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:45.064759 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:45.065139 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:45.066223 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:45.066748 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:45.085121 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Getting quotas for project 30d028fa9b854c8fb71c8cbed2985c27. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:12:45.091190 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Getting quotas for user 52281b3989a04ca2a50b0bc93bf783f0 and project 30d028fa9b854c8fb71c8cbed2985c27. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:12:45.103174 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] [instance: 08e7e1f9-8b5c-446c-a05f-d8043473dd35] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:12:45.104796 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:45.105237 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:45.182985 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] [instance: 08e7e1f9-8b5c-446c-a05f-d8043473dd35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:12:45.184585 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:45.184998 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:45.493415 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:45.494148 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-efb26acc-e646-4d66-bad5-e0b773928ef0 tempest-VolumesAdminNegativeTest-1468695956 tempest-VolumesAdminNegativeTest-1468695956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:46.871761 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:12:46.920703 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:46.921121 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:47.184912 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:47.186531 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:47.188000 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:47.189149 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:47.189742 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:47.223354 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Getting quotas for project cad2f07400d54ef9825022d5b3489db0. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:12:47.229257 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Getting quotas for user 2db871d6aa9746d2b660efbfbdb1dc75 and project cad2f07400d54ef9825022d5b3489db0. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:12:47.241100 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] [instance: 6e68dbd6-1d5c-471e-ad69-cf1c4aa4004a] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:12:47.242063 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:47.242539 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:47.353657 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] [instance: 6e68dbd6-1d5c-471e-ad69-cf1c4aa4004a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:12:47.354974 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:47.355425 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:47.669008 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:47.669428 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a5e13eba-0afe-4391-99f7-0ee7a4e991c2 tempest-TenantUsagesTestJSON-260059616 tempest-TenantUsagesTestJSON-260059616-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:53.216862 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-bdfaf651-8520-430e-a989-078c2b52b221 tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:12:53.217435 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-bdfaf651-8520-430e-a989-078c2b52b221 tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:12:53.217853 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-bdfaf651-8520-430e-a989-078c2b52b221 tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:12:53.666517 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-bdfaf651-8520-430e-a989-078c2b52b221 tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] [instance: 126f561c-163f-4f6d-8be1-98a2e29b0909] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 21:12:54.366900 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-bdfaf651-8520-430e-a989-078c2b52b221 tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] Created allocations for migration 155efcb7-8809-481a-ba66-b5ec1181fcb9 on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:12:54.897771 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:55.075321 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:55.228044 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-bdfaf651-8520-430e-a989-078c2b52b221 tempest-MigrationsAdminTest-399208122 tempest-MigrationsAdminTest-399208122-project-admin] [instance: 126f561c-163f-4f6d-8be1-98a2e29b0909] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 21:12:57.202021 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:57.360339 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:57.562510 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:57.563748 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:58.858303 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:13:05.251390 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:05.253939 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:06.037749 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=20,nova_cell1:UPDATE=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:24.866926 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:24.907842 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:35.536034 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Took 1.33 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:13:35.587965 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:35.588812 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:35.968733 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:35.969153 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:35.973409 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:35.973409 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:36.014658 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Getting quotas for project 45d9edd2fe854483a6f0d676efbd6622. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:13:36.022690 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Getting quotas for user c1aea87154224f1c81428ddef4438801 and project 45d9edd2fe854483a6f0d676efbd6622. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:13:36.077146 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] [instance: 4602867b-88ed-43b1-9ee6-bf661e2d7d99] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:13:36.077146 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:36.077146 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:36.183262 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] [instance: 4602867b-88ed-43b1-9ee6-bf661e2d7d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:13:36.186746 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:36.187518 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:36.545448 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:36.545448 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5ac6ffc4-0e53-44d4-86e7-e60c9c111793 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:39.178974 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:13:43.167536 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:13:43.253430 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:43.254171 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:43.674615 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:43.675135 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:43.675988 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:43.678931 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:43.780839 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Getting quotas for project 6c2095f96f8d45bb9e62c517678c3dcd. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:13:43.817800 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Getting quotas for user 2eba2ac21c344394a7d3f605775b8713 and project 6c2095f96f8d45bb9e62c517678c3dcd. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:13:43.898152 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] [instance: dada2ea0-2ef4-4a30-8e2d-40177d0bafce] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:13:43.908242 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:43.912149 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:44.025341 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] [instance: dada2ea0-2ef4-4a30-8e2d-40177d0bafce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:13:44.026745 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:44.027244 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:44.329802 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:44.331390 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d801fba-b6b5-4302-b847-a1e7948f3525 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507 tempest-FloatingIPsAssociationNegativeTestJSON-1411074507-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:45.998256 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:46.193903 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:46.332262 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:46.439474 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:49.606251 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:13:49.610447 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:49.610871 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:52.953587 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Created allocations for migration 8560aee6-97f3-40da-be19-b4777373559a on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129815) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:13:53.390416 ncdv-master-1 nova-conductor[129815]: DEBUG nova.scheduler.utils [None req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] [instance: 3c5ab09e-0a97-4cfc-b249-a11ab221b5d2] Instance allocations successfully created on destination node fcc75857-7dde-4ac0-88e4-871d39001997: {'allocations': {'fcc75857-7dde-4ac0-88e4-871d39001997': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=129815) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Jul 16 21:13:53.391421 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lazy-loading 'resources' on Instance uuid 3c5ab09e-0a97-4cfc-b249-a11ab221b5d2 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:13:53.398924 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lazy-loading 'pci_requests' on Instance uuid 3c5ab09e-0a97-4cfc-b249-a11ab221b5d2 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:13:53.738659 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:53.780502 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:13:53.829593 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:53.830589 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:54.183563 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:54.183994 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:54.188197 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:54.190651 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:54.231259 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Getting quotas for project 4337575622d04a26942905c9dc044ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:13:54.238967 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Getting quotas for user 4e9df82f95ac4779859972403869096a and project 4337575622d04a26942905c9dc044ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:13:54.258977 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] [instance: e66baae9-d488-46a4-8347-623030fc8b69] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:13:54.261048 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:54.262624 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:54.321720 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.live_migrate [None req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] [instance: 3c5ab09e-0a97-4cfc-b249-a11ab221b5d2] Start binding ports on destination host: nch1-master-1 {{(pid=129815) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:13:54.366058 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] [instance: e66baae9-d488-46a4-8347-623030fc8b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:13:54.368520 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:54.369086 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:54.702504 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:54.703495 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f2e73bf7-9902-4ccd-a7b1-bcf2d3c7f713 tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:58.606912 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Took 1.11 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:13:58.670961 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:58.674067 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:58.979364 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:58.986300 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:58.990678 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:58.994697 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:58.997162 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:59.028376 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Getting quotas for project bb1ede0d0b6941cc97278e6c617f9b01. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:13:59.034770 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Getting quotas for user 53af488f3b0242a797f539284b78d59e and project bb1ede0d0b6941cc97278e6c617f9b01. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:13:59.052454 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] [instance: 69cabe57-da71-4a02-b4ee-c0d84b3d32a2] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:13:59.054706 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:59.055644 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:59.130082 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] [instance: 69cabe57-da71-4a02-b4ee-c0d84b3d32a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:13:59.133422 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:59.134112 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:13:59.559584 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:13:59.561601 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ecc5126d-3e38-46ea-8e4b-09e360990a36 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:14:04.386791 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=36,nova_cell1:RELEASE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:04.482060 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:04.723995 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:04.815253 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:14:04.838196 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:14:04.838614 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:14:04.914571 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:05.041917 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:14:05.042351 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:14:05.043207 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:14:05.043992 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:14:05.063367 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Getting quotas for project 45d9edd2fe854483a6f0d676efbd6622. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:14:05.068485 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Getting quotas for user c1aea87154224f1c81428ddef4438801 and project 45d9edd2fe854483a6f0d676efbd6622. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:14:05.085953 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] [instance: 76ee9d21-1f17-4b64-8f95-95a33e70e907] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:14:05.087091 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:14:05.087814 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:14:05.286087 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] [instance: 76ee9d21-1f17-4b64-8f95-95a33e70e907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:14:05.292054 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:14:05.293837 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:14:05.657681 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:14:05.661882 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c766f625-f884-4ecd-aee1-7a1b9d706b68 tempest-ServersAdminNegativeTestJSON-1083411175 tempest-ServersAdminNegativeTestJSON-1083411175-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:14:09.014092 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:09.141344 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=20,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:09.419076 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:09.420482 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:15.552260 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:16.179771 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:19.645163 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:34.873634 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:44.922715 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:54.882377 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:01.184345 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:15:01.243641 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.244141 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:01.476907 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.477353 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:01.478128 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.483342 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:01.544219 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:15:01.545106 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Getting quotas for project 4337575622d04a26942905c9dc044ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:15:01.569666 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Getting quotas for user 4e9df82f95ac4779859972403869096a and project 4337575622d04a26942905c9dc044ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:15:01.595359 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.596148 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:01.624123 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] [instance: 39e51d01-21e0-4dd5-bfd4-16b0f8b0f827] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:15:01.633425 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.638753 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:01.766655 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] [instance: 39e51d01-21e0-4dd5-bfd4-16b0f8b0f827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:15:01.769778 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.769778 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:01.795181 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.795181 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:01.795684 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.798243 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:01.855026 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Getting quotas for project 9b769bf8f3ea4e368bf68de1df6538f9. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:15:01.879954 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Getting quotas for user 6a69f9dee03d43beaafa966216b9e289 and project 9b769bf8f3ea4e368bf68de1df6538f9. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:15:01.946033 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] [instance: 23df6e0a-3637-4f59-93f9-b02dd614b5c3] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:15:01.947363 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:01.947951 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:02.076129 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] [instance: 23df6e0a-3637-4f59-93f9-b02dd614b5c3] block_device_mapping [BlockDeviceMapping(attachment_id=fcbbc1ee-41d3-4590-b8c8-66b7a23198f9,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb5651c9-06af-46c0-905c-8ecec06e7945',volume_size=1,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:15:02.079339 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:02.079339 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:02.198189 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:02.198769 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8ece112b-56ee-4f77-bd72-e063425b5d7f tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:02.540977 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:02.545736 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-8f25d619-09e1-4071-8910-4b32863bbd42 tempest-LiveMigrationTest-1001758322 tempest-LiveMigrationTest-1001758322-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:03.618864 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:15:03.666582 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:03.666993 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:03.938783 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:03.938783 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:03.938783 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:03.938783 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:03.965306 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Getting quotas for project bb1ede0d0b6941cc97278e6c617f9b01. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:15:03.971551 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Getting quotas for user 53af488f3b0242a797f539284b78d59e and project bb1ede0d0b6941cc97278e6c617f9b01. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:15:03.994609 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] [instance: 0079e567-30df-4cac-a0ad-4379bcbbcf48] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:15:04.001396 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:04.001396 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:04.080971 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] [instance: 0079e567-30df-4cac-a0ad-4379bcbbcf48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:15:04.082292 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:04.084198 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:04.381925 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:04.387121 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a4c2d7b9-9f27-4564-b664-1133f762af46 tempest-ServersTestMultiNic-262233723 tempest-ServersTestMultiNic-262233723-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:06.095783 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Took 0.94 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:15:06.198663 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:06.205708 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:06.436219 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:06.441141 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:06.442736 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:06.443364 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:06.533709 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Getting quotas for project d9b92fc544c544f686ac2ab7ff5123b6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:15:06.546834 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Getting quotas for user 578b87f863b34f57a571f7e56d44f118 and project d9b92fc544c544f686ac2ab7ff5123b6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:15:06.587908 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] [instance: 84ab7e65-1bf0-4b8b-baea-6d1d4ca13dd7] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:15:06.593016 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:06.593455 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:06.698273 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] [instance: 84ab7e65-1bf0-4b8b-baea-6d1d4ca13dd7] block_device_mapping [BlockDeviceMapping(attachment_id=bfef8cdf-8a3e-444a-b64f-6c5244e55158,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab',volume_size=1,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:15:06.700770 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:06.703603 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:07.048240 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:07.050762 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d9673510-f870-4ce5-b805-a61fa4563efe tempest-LiveAutoBlockMigrationV225Test-1461646193 tempest-LiveAutoBlockMigrationV225Test-1461646193-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:13.952790 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:14.089774 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=34 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:14.190557 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:14.282391 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:14.892111 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:16.504856 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:16.717829 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=31 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:16.804292 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=24 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:16.908206 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:24.938804 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:28.227274 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:15:28.299334 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:28.300043 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:28.604692 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:28.605672 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:28.607138 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:28.608140 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:28.637015 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Getting quotas for project 24c64db8082648c8837c16352252f96d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:15:28.648719 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Getting quotas for user daf3c9e6634e4ae1bfb492eae1f44c93 and project 24c64db8082648c8837c16352252f96d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:15:28.666155 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] [instance: 93e327c3-c63d-439a-9b25-1a805f785949] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:15:28.667460 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:28.668029 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:28.742545 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] [instance: 93e327c3-c63d-439a-9b25-1a805f785949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:15:28.744172 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:28.745256 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:29.203395 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:29.205136 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3c5ed771-3073-402c-8c07-edc43d3a5239 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:35.112374 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-04a95fcb-5164-4efb-833f-82c94fd8a734 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:15:35.113544 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-04a95fcb-5164-4efb-833f-82c94fd8a734 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:35.115731 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-04a95fcb-5164-4efb-833f-82c94fd8a734 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:36.225168 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-04a95fcb-5164-4efb-833f-82c94fd8a734 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Created allocations for migration 091bcfc9-2fe1-4602-8fb8-ffee98ebc06f on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:15:36.600238 ncdv-master-1 nova-conductor[129816]: DEBUG nova.scheduler.utils [None req-04a95fcb-5164-4efb-833f-82c94fd8a734 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] [instance: 23df6e0a-3637-4f59-93f9-b02dd614b5c3] Instance allocations successfully created on destination node fcc75857-7dde-4ac0-88e4-871d39001997: {'allocations': {'fcc75857-7dde-4ac0-88e4-871d39001997': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=129816) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Jul 16 21:15:36.601346 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-04a95fcb-5164-4efb-833f-82c94fd8a734 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lazy-loading 'resources' on Instance uuid 23df6e0a-3637-4f59-93f9-b02dd614b5c3 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:15:36.609041 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-04a95fcb-5164-4efb-833f-82c94fd8a734 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] Lazy-loading 'pci_requests' on Instance uuid 23df6e0a-3637-4f59-93f9-b02dd614b5c3 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:15:38.432519 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.live_migrate [None req-04a95fcb-5164-4efb-833f-82c94fd8a734 tempest-LiveMigrationTest-1131758637 tempest-LiveMigrationTest-1131758637-project-admin] [instance: 23df6e0a-3637-4f59-93f9-b02dd614b5c3] Start binding ports on destination host: nch1-master-1 {{(pid=129816) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:15:38.625776 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:38.753670 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:38.867334 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:38.988864 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:41.039644 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:15:41.043910 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:41.044448 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:42.677434 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Created allocations for migration 5be4393a-e888-4a2e-8c4e-f7ba3ab49397 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129815) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:15:43.036847 ncdv-master-1 nova-conductor[129815]: DEBUG nova.scheduler.utils [None req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] [instance: 84ab7e65-1bf0-4b8b-baea-6d1d4ca13dd7] Instance allocations successfully created on destination node c18c7b31-cb52-43e0-ba1f-41c40f4e73e5: {'allocations': {'c18c7b31-cb52-43e0-ba1f-41c40f4e73e5': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=129815) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:851}} Jul 16 21:15:43.036847 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lazy-loading 'resources' on Instance uuid 84ab7e65-1bf0-4b8b-baea-6d1d4ca13dd7 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:15:43.042465 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] Lazy-loading 'pci_requests' on Instance uuid 84ab7e65-1bf0-4b8b-baea-6d1d4ca13dd7 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:15:43.952223 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.live_migrate [None req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 tempest-LiveAutoBlockMigrationV225Test-1179203521 tempest-LiveAutoBlockMigrationV225Test-1179203521-project-admin] [instance: 84ab7e65-1bf0-4b8b-baea-6d1d4ca13dd7] Start binding ports on destination host: nch2-master-1 {{(pid=129815) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:15:44.933003 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:49.131289 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:49.396238 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:49.605881 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:15:49.650011 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:49.652765 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:49.933020 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:49.933439 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:49.934420 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:49.934991 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:49.954181 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Getting quotas for project d82c2d92c67f469e863eb70bb7f9af84. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:15:49.960593 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Getting quotas for user 1aa99be675e946fd995d71465b4cbec6 and project d82c2d92c67f469e863eb70bb7f9af84. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:15:49.974591 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] [instance: b9f2c527-6346-4403-841e-b7bd876a5fb7] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:15:49.976068 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:49.976675 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:50.067640 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] [instance: b9f2c527-6346-4403-841e-b7bd876a5fb7] block_device_mapping [BlockDeviceMapping(attachment_id=bd0c98c2-19ec-4cce-8e61-c086d28da019,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fa5082b-070c-4f64-9f0b-f24264ffca4a',volume_size=1,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:15:50.069140 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:50.069836 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:50.488969 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:50.490227 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-827020c3-b1da-40ae-8aae-d3c2ea617930 tempest-ServersTestBootFromVolume-1080567873 tempest-ServersTestBootFromVolume-1080567873-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:52.451969 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:15:52.539176 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:52.539630 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:52.735720 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:52.739425 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:52.740018 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:52.741456 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:52.742257 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:52.780517 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Getting quotas for project 4337575622d04a26942905c9dc044ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:15:52.790794 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Getting quotas for user 4e9df82f95ac4779859972403869096a and project 4337575622d04a26942905c9dc044ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:15:52.816958 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] [instance: f6c350c4-b1b2-42d3-ba02-65cbbacf0f58] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:15:52.825731 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:52.827143 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:52.987302 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] [instance: f6c350c4-b1b2-42d3-ba02-65cbbacf0f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:15:52.991283 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:52.991283 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:53.314945 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:53.315387 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-0cb056f2-b0c3-4448-b82e-16f898fc625a tempest-ImagesOneServerNegativeTestJSON-526509748 tempest-ImagesOneServerNegativeTestJSON-526509748-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:54.000288 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:15:54.035473 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:54.036292 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:54.527289 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:54.527870 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:54.530065 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:54.530476 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:54.553089 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Getting quotas for project a90d4bcd25ff4bf68bdc194180fbbe09. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:15:54.559552 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Getting quotas for user dd4144b5388b46a989a41a2f556bb508 and project a90d4bcd25ff4bf68bdc194180fbbe09. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:15:54.575375 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] [instance: 11194822-5d42-45f4-99d0-88c70c808ddd] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:15:54.576787 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:54.577359 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:54.657819 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] [instance: 11194822-5d42-45f4-99d0-88c70c808ddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:15:54.659636 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:54.659988 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:15:55.042685 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:15:55.043360 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7037a7f0-e564-4b98-9696-f12b38443f15 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:02.752663 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:02.994964 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=19 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:03.237757 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:03.238559 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:04.541426 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:04.663831 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=35,nova_cell1:RELEASE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:04.783079 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:04.936764 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:04.946442 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:18.868516 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:16:22.300908 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:16:22.347126 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:22.347546 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:22.633667 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:22.634198 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:22.634999 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:22.637625 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:22.697279 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Getting quotas for project 9f5f03e09936489fa1505188cefe3445. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:16:22.720123 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Getting quotas for user 015ac1bbb2df487e99e5bddc60ee6923 and project 9f5f03e09936489fa1505188cefe3445. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:16:22.750121 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] [instance: 0bcfc499-2e0f-48b6-994a-e0cb74ac7b4f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:16:22.752075 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:22.752592 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:22.847120 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] [instance: 0bcfc499-2e0f-48b6-994a-e0cb74ac7b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:16:22.847120 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:22.847849 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:23.195214 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:23.195214 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-5474d3a2-0463-4f41-b925-ffd7d3da8850 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:23.211883 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:16:23.257068 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:23.259087 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:23.446672 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:23.447435 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:23.448357 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:23.449195 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:23.469901 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Getting quotas for project 9f5f03e09936489fa1505188cefe3445. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:16:23.477617 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Getting quotas for user 015ac1bbb2df487e99e5bddc60ee6923 and project 9f5f03e09936489fa1505188cefe3445. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:16:23.497853 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] [instance: 9657dddc-2416-4c95-aab3-d6b6f9673369] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:16:23.502353 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:23.503672 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:23.586224 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] [instance: 9657dddc-2416-4c95-aab3-d6b6f9673369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:16:23.587903 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:23.588517 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:23.630325 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-1df90ee3-57e5-4406-9124-1d9cfc97c87c tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:16:23.631026 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1df90ee3-57e5-4406-9124-1d9cfc97c87c tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:23.633032 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1df90ee3-57e5-4406-9124-1d9cfc97c87c tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:23.768065 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-1df90ee3-57e5-4406-9124-1d9cfc97c87c tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] [instance: 11194822-5d42-45f4-99d0-88c70c808ddd] No migration record for the rebuild/evacuate request. {{(pid=129815) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:16:23.994274 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:23.996093 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23d8b976-5108-4178-a9a8-11f83a88c05d tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:26.386211 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:16:26.467854 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:26.468305 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:26.731875 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:26.732490 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:26.733628 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:26.734232 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:26.812474 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Getting quotas for project 24c64db8082648c8837c16352252f96d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:16:26.839798 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Getting quotas for user daf3c9e6634e4ae1bfb492eae1f44c93 and project 24c64db8082648c8837c16352252f96d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:16:26.864522 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] [instance: f03a2a83-e007-444a-b46b-70eb46bb242b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:16:26.866448 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:26.870463 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:27.019593 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] [instance: f03a2a83-e007-444a-b46b-70eb46bb242b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:16:27.023459 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:27.024143 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:27.305196 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:27.305983 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-cbd74573-2a04-4f4a-977f-f0e027a469a7 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:32.133944 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c697b4fe-732d-4ddb-a036-80d49dbd6b49 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:16:32.136760 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c697b4fe-732d-4ddb-a036-80d49dbd6b49 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:32.137295 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c697b4fe-732d-4ddb-a036-80d49dbd6b49 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:32.328203 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c697b4fe-732d-4ddb-a036-80d49dbd6b49 tempest-ServerShowV247Test-1709646099 tempest-ServerShowV247Test-1709646099-project] [instance: 9657dddc-2416-4c95-aab3-d6b6f9673369] No migration record for the rebuild/evacuate request. {{(pid=129815) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:16:32.674247 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:34.294079 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:16:34.336262 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:34.337041 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:34.648013 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:34.648364 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:34.649101 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:34.657603 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:34.701993 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Getting quotas for project 57c1e99ad9884d79812e95fbc81512da. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:16:34.717921 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Getting quotas for user b7a14721381b4f2cb4def5be76b7b645 and project 57c1e99ad9884d79812e95fbc81512da. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:16:34.745716 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] [instance: e6844cd4-a382-45cc-ab21-bd7f2ede46e2] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:16:34.747958 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:34.749642 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:34.898259 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:34.914280 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] [instance: e6844cd4-a382-45cc-ab21-bd7f2ede46e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:16:34.917463 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:34.918526 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:35.326440 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:35.327842 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b2299d10-82a0-4934-8b64-8912995d846f tempest-ImagesNegativeTestJSON-1746139659 tempest-ImagesNegativeTestJSON-1746139659-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:42.127215 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:42.339912 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:42.369044 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=23,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=20,nova_cell1:RELEASE=1,nova_cell1:UPDATE=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:44.668713 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:44.924472 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=52,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:44.950821 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:45.051868 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:45.198604 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:49.755125 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:16:49.785317 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:49.785726 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:50.068433 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:50.068919 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:50.069763 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:50.070252 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:50.102189 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Getting quotas for project 7e84496d78d4481e9d7648128868bca2. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:16:50.109877 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Getting quotas for user 71e9304fc50447d6aac99703b5b6e4e1 and project 7e84496d78d4481e9d7648128868bca2. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:16:50.123611 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] [instance: b9a4910a-f117-4834-b699-498c6431b9bb] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:16:50.125117 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:50.125770 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:50.233288 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] [instance: b9a4910a-f117-4834-b699-498c6431b9bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:16:50.235297 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:50.235877 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:50.627639 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:50.627639 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-70c01863-c230-43ac-8143-54382f197de3 tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:51.003063 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:16:51.039157 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:51.039567 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:51.348508 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:51.348927 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:51.349672 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:51.350076 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:51.371277 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Getting quotas for project 7e84496d78d4481e9d7648128868bca2. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:16:51.377083 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Getting quotas for user 71e9304fc50447d6aac99703b5b6e4e1 and project 7e84496d78d4481e9d7648128868bca2. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:16:51.388996 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] [instance: 6cb4e66a-eba2-42b7-91e8-09ee7b2a5a4f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:16:51.390461 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:51.390792 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:51.520808 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] [instance: 6cb4e66a-eba2-42b7-91e8-09ee7b2a5a4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:16:51.522066 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:51.522477 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:51.864128 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:16:51.864609 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c1e7e7ef-55e0-4e7a-a7c5-5e6ddf0b163a tempest-ListImageFiltersTestJSON-1083290149 tempest-ListImageFiltersTestJSON-1083290149-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:16:59.187974 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:17:00.087930 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:00.239585 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:00.402593 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:00.535192 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:01.358941 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:01.526164 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:01.685388 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:01.757156 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:04.285190 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:17:04.340083 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:04.340598 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:04.549064 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:04.549629 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:04.550549 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:04.551208 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:04.581143 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Getting quotas for project a90d4bcd25ff4bf68bdc194180fbbe09. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:17:04.593392 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Getting quotas for user dd4144b5388b46a989a41a2f556bb508 and project a90d4bcd25ff4bf68bdc194180fbbe09. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:17:04.621952 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] [instance: 7e4b142d-f489-4220-adc3-7b348dc14ce9] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:17:04.625611 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:04.628707 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:04.800172 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] [instance: 7e4b142d-f489-4220-adc3-7b348dc14ce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:17:04.800172 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:04.800172 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:05.261539 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:05.262549 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-828ec50a-aa31-4cea-b022-6cea3a99a9bd tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:06.457636 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:17:06.485934 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:06.486847 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:06.829068 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:06.832415 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:06.832415 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:06.832415 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:06.851172 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Getting quotas for project 65d5bcfa02af4e8284ba1342197e2860. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:17:06.867231 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Getting quotas for user 2f5bc1f2209f4eb186d80e385b67c774 and project 65d5bcfa02af4e8284ba1342197e2860. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:17:06.897670 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] [instance: e7598b4a-f70c-4186-88d1-6fd0057f8656] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:17:06.898777 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:06.899209 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:06.991147 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] [instance: e7598b4a-f70c-4186-88d1-6fd0057f8656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:17:06.992625 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:06.993044 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:07.152801 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:17:07.200155 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:07.203741 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:07.377046 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:07.378659 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-42f32a2c-d8b4-4509-b1e6-61773e30958a tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:07.414066 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:07.417187 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:07.417661 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:07.418540 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:07.419786 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:07.473458 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Getting quotas for project 65d5bcfa02af4e8284ba1342197e2860. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:17:07.481403 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Getting quotas for user 2f5bc1f2209f4eb186d80e385b67c774 and project 65d5bcfa02af4e8284ba1342197e2860. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:17:07.495578 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] [instance: aa688a7e-0b28-4dfd-a159-8e19fd62ee02] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:17:07.496680 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:07.497135 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:07.611347 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] [instance: aa688a7e-0b28-4dfd-a159-8e19fd62ee02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:17:07.612609 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:07.613010 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:07.957687 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:07.958389 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-efdbd07c-2d69-4e16-a290-48dd5281dc1f tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:16.838795 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:17.000615 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:17.279834 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:17.280727 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:17.459310 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:17.617163 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=34 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:17.866844 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=21 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:17.870466 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:24.965961 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:38.353523 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4d76ba2c-d147-4244-9eec-1726f0cb7856 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:17:38.354220 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4d76ba2c-d147-4244-9eec-1726f0cb7856 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:38.354627 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4d76ba2c-d147-4244-9eec-1726f0cb7856 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:38.470052 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4d76ba2c-d147-4244-9eec-1726f0cb7856 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] [instance: 7e4b142d-f489-4220-adc3-7b348dc14ce9] No migration record for the rebuild/evacuate request. {{(pid=129816) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:17:43.081483 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Took 1.11 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:17:43.123456 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:43.125377 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:43.548594 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:43.551492 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:43.556066 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:43.557151 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:43.560359 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:43.588894 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Getting quotas for project e353258f9c3048ef84683294e2b8579d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:17:43.594447 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Getting quotas for user d0008fffad8e4708b2c01e03da92c47d and project e353258f9c3048ef84683294e2b8579d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:17:43.616101 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] [instance: b8565a82-250b-4f64-9d90-98b368e4bd57] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:17:43.620058 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:43.620685 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:43.744537 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] [instance: b8565a82-250b-4f64-9d90-98b368e4bd57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:17:43.745915 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:43.747391 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:44.130867 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:44.130867 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c45032d7-2ed8-4381-937f-2a6c9af7bff0 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:46.191208 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:17:46.232845 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:46.233672 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:46.459765 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:46.460718 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:46.462927 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:46.464533 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:46.503422 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Getting quotas for project 65d5bcfa02af4e8284ba1342197e2860. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:17:46.515473 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Getting quotas for user 2f5bc1f2209f4eb186d80e385b67c774 and project 65d5bcfa02af4e8284ba1342197e2860. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:17:46.545984 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] [instance: 720ef2b0-e7b3-4b36-b613-1b73d2bae2e9] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:17:46.546966 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:46.547420 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:46.705644 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] [instance: 720ef2b0-e7b3-4b36-b613-1b73d2bae2e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:17:46.706899 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:46.707338 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:47.013626 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:47.014847 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5aaea6f6-21be-4787-9378-ee7a46ab5ebe tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:48.325937 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:17:48.368934 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:48.370831 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:48.573297 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:48.573738 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:48.575077 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:48.576025 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:48.603325 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Getting quotas for project 24c64db8082648c8837c16352252f96d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:17:48.609681 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Getting quotas for user daf3c9e6634e4ae1bfb492eae1f44c93 and project 24c64db8082648c8837c16352252f96d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:17:48.625647 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] [instance: ed8dcb97-7546-45ef-9e9d-a9bb03a1b419] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:17:48.627298 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:48.627871 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:48.728669 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] [instance: ed8dcb97-7546-45ef-9e9d-a9bb03a1b419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:17:48.730518 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:48.732217 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:49.165267 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:49.166054 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-a7942f6d-68af-4fe7-ab47-d5e81e048546 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:56.481776 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:56.666260 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:17:56.716878 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=3,nova_cell1:INSERT=18 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:56.716878 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:56.716878 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:57.079707 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:57.085068 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:57.085598 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:57.086594 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:57.087125 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:57.109941 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Getting quotas for project ba229aaef0ec4ddcadd1d940376c31ac. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:17:57.124583 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Getting quotas for user 50cdc134e712487196f6623c5cf14592 and project ba229aaef0ec4ddcadd1d940376c31ac. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:17:57.140677 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] [instance: 43169d4f-1214-419a-aa1e-def65182ed5a] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:17:57.141876 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:57.142358 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:57.240493 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] [instance: 43169d4f-1214-419a-aa1e-def65182ed5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:17:57.242952 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:57.243690 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:57.623125 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:17:57.624217 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d72286dd-43f9-40ab-8591-7ff70024fb94 tempest-ServersNegativeTestMultiTenantJSON-1135003248 tempest-ServersNegativeTestMultiTenantJSON-1135003248-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:17:58.591246 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:58.739815 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=35,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:58.893963 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:59.031801 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:04.679260 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:18:04.755801 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:04.757306 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:04.896982 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:04.898028 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:04.899335 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:04.900498 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:04.929554 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Getting quotas for project a90d4bcd25ff4bf68bdc194180fbbe09. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:18:04.938077 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Getting quotas for user dd4144b5388b46a989a41a2f556bb508 and project a90d4bcd25ff4bf68bdc194180fbbe09. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:18:04.952390 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] [instance: 6baac85b-f81c-4e3a-9f96-633cffccfd74] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:18:04.953659 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:04.954255 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:05.148477 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] [instance: 6baac85b-f81c-4e3a-9f96-633cffccfd74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:18:05.149797 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:05.150213 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:05.574349 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:05.575272 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-34fd4ca8-bbad-482a-ae27-e2014ab6da22 tempest-ServerDiskConfigTestJSON-760881222 tempest-ServerDiskConfigTestJSON-760881222-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:07.189947 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:07.508830 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:07.509878 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:08.911513 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:14.912866 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:14.978644 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:15.155295 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:15.371610 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:15.372457 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:24.932207 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=25,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:34.989213 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:35.314229 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-bf0a0658-28ca-48db-a48d-542cb643723d tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:18:35.319457 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-bf0a0658-28ca-48db-a48d-542cb643723d tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:35.319457 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-bf0a0658-28ca-48db-a48d-542cb643723d tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:35.440202 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-bf0a0658-28ca-48db-a48d-542cb643723d tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] [instance: e7598b4a-f70c-4186-88d1-6fd0057f8656] No migration record for the rebuild/evacuate request. {{(pid=129816) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:18:39.131438 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:18:39.156961 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:39.157729 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:39.349761 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:39.350393 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:39.351414 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:39.352115 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:39.377987 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Getting quotas for project e353258f9c3048ef84683294e2b8579d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:18:39.384775 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Getting quotas for user d0008fffad8e4708b2c01e03da92c47d and project e353258f9c3048ef84683294e2b8579d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:18:39.397733 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] [instance: c88b191a-1ae5-4952-8afa-14aee5567a7f] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:18:39.398697 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:39.399135 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:39.497258 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] [instance: c88b191a-1ae5-4952-8afa-14aee5567a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:18:39.499161 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:39.499946 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:39.803333 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:39.804163 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9ee970e0-4444-45ec-ab25-ef813e894b13 tempest-SecurityGroupsTestJSON-438340169 tempest-SecurityGroupsTestJSON-438340169-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:41.332725 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:18:41.366058 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:41.366533 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:41.582866 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:41.583563 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:41.585475 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:41.587326 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:41.615403 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Getting quotas for project 24c64db8082648c8837c16352252f96d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:18:41.622636 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Getting quotas for user daf3c9e6634e4ae1bfb492eae1f44c93 and project 24c64db8082648c8837c16352252f96d. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:18:41.648344 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] [instance: d265192b-536b-4884-9fe8-74cf20fc7ef9] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:18:41.649489 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:41.650395 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:41.770087 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] [instance: d265192b-536b-4884-9fe8-74cf20fc7ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:18:41.771424 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:41.771839 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:42.123710 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:18:42.125150 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-18b649bc-024a-419c-bf63-1b94c9f94867 tempest-ImagesTestJSON-1532827163 tempest-ImagesTestJSON-1532827163-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:18:49.366834 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:49.512083 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:49.605642 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=16 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:49.701860 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:51.604014 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:51.775755 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=3,nova_cell1:INSERT=18 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:52.020711 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:52.021537 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:04.939555 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:04.995038 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:07.285370 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Took 1.23 seconds to select destinations for 2 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:19:07.344210 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:07.347137 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:07.677034 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:07.682264 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:07.927294 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:07.927707 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:07.931234 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:07.931234 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:07.948653 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Getting quotas for project a092ce9ef40943f6b6ace6cd28481b71. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:19:07.954040 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Getting quotas for user eebb224a56814f92b12ebebebc6bc8a3 and project a092ce9ef40943f6b6ace6cd28481b71. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:19:07.973360 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] [instance: 21522211-8382-4958-ad2a-cff26f4f2305] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:19:07.974712 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:07.975349 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:08.056838 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-87f8c399-cae5-4010-81b0-989c116a778d tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:19:08.057617 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87f8c399-cae5-4010-81b0-989c116a778d tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:08.058314 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87f8c399-cae5-4010-81b0-989c116a778d tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:08.077996 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] [instance: 21522211-8382-4958-ad2a-cff26f4f2305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:19:08.082445 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:08.082891 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:08.220857 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-87f8c399-cae5-4010-81b0-989c116a778d tempest-ServersAdminTestJSON-1438684720 tempest-ServersAdminTestJSON-1438684720-project] [instance: e7598b4a-f70c-4186-88d1-6fd0057f8656] No migration record for the rebuild/evacuate request. {{(pid=129816) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:19:08.549312 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:08.549755 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:08.593405 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] [instance: c16e5f09-f813-414e-b233-c08348078624] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:19:08.596051 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:08.596473 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:08.704311 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] [instance: c16e5f09-f813-414e-b233-c08348078624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:19:08.705943 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:08.706663 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:08.999207 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:08.999207 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e981bf20-695e-4bd9-9581-0e6c9cc362e6 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:12.744391 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:19:12.780808 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:12.781485 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:13.028599 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:13.029430 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:13.033284 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:13.034535 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:13.099743 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Getting quotas for project f2984288b4cd4610b2f32e895f3e5d72. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:19:13.116347 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Getting quotas for user a8d48b52db1545a4a51027a5c2c7fcce and project f2984288b4cd4610b2f32e895f3e5d72. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:19:13.147634 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] [instance: a51adaf1-9c26-47d0-92c2-b6bb065a5ee8] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:19:13.151211 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:13.151658 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:13.243426 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] [instance: a51adaf1-9c26-47d0-92c2-b6bb065a5ee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:19:13.244978 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:13.245394 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:13.556519 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:13.560276 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-660732bb-4cd9-4d16-a6c4-879cd9a21f7a tempest-ServersAaction247Test-725202529 tempest-ServersAaction247Test-725202529-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:18.230227 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:18.235718 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:18.289311 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:23.061390 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:23.249173 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=25,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=53,nova_cell1:RELEASE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:23.390452 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:23.469166 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:33.150695 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Took 1.18 seconds to select destinations for 2 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:19:33.202571 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:33.203113 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:33.471655 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:33.471832 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:33.730597 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:33.731340 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:33.732323 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:33.732818 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:33.778333 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Getting quotas for project a092ce9ef40943f6b6ace6cd28481b71. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:19:33.786721 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Getting quotas for user eebb224a56814f92b12ebebebc6bc8a3 and project a092ce9ef40943f6b6ace6cd28481b71. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:19:33.805893 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] [instance: 9d2cd0fc-1101-4e21-8179-c1dd4605594f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:19:33.807027 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:33.807550 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:33.901454 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] [instance: 9d2cd0fc-1101-4e21-8179-c1dd4605594f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:19:33.904471 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:33.904904 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:34.387224 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:34.387788 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:34.410178 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] [instance: a56f8463-6006-4805-9021-1babc2d98f0f] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:19:34.417086 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:34.419183 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:34.537493 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] [instance: a56f8463-6006-4805-9021-1babc2d98f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:19:34.539107 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:34.545223 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:34.941875 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:34.943294 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ed2-52b4-4968-842b-2cd93aa37537 tempest-MultipleCreateTestJSON-874278387 tempest-MultipleCreateTestJSON-874278387-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:34.946108 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=17,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:38.887106 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:19:43.759515 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:44.545371 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=34 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:44.667600 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:44.779988 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:44.996896 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:57.373290 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Took 0.98 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:19:57.428708 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:57.433739 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:57.732465 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:57.732879 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:57.734939 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:57.737646 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:57.781868 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Getting quotas for project 0be222897b3a4864a39e9fc7d481340a. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:19:57.792911 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Getting quotas for user 1f72b1e0b4124480bfd53b5c22a343e0 and project 0be222897b3a4864a39e9fc7d481340a. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:19:57.809985 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] [instance: 0a9564cb-c375-47e9-bfe6-e68d4700442b] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:19:57.811541 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:57.812301 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:57.939290 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] [instance: 0a9564cb-c375-47e9-bfe6-e68d4700442b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:19:57.941440 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:57.942039 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:19:58.272984 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:19:58.274519 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3bafb7cd-2bf2-475a-b7f7-816a07c0457c tempest-ServersTestManualDisk-1287576747 tempest-ServersTestManualDisk-1287576747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:01.804863 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:01.804863 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:03.073550 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Took 1.08 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:20:03.142777 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:03.144002 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:03.580468 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:03.582680 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:03.585044 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:03.587796 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:03.639764 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Getting quotas for project 772bd01188344e288824730238fee49b. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:20:03.655251 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Getting quotas for user fe680ccdc60e410b812794de8aa73e0f and project 772bd01188344e288824730238fee49b. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:20:03.679996 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] [instance: 84aa4a51-e376-4829-9a38-2ea447ebb413] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:20:03.681055 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:03.681474 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:03.751910 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] [instance: 84aa4a51-e376-4829-9a38-2ea447ebb413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:20:03.754068 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:03.755225 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:04.084462 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:04.084462 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d7c7baa2-d4e8-4416-b1e1-015d02e7f09d tempest-ServerGroupTestJSON-2037884880 tempest-ServerGroupTestJSON-2037884880-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:06.946134 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:20:06.972326 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:06.973126 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:07.248544 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:07.249306 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:07.250272 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:07.251197 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:07.273362 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Getting quotas for project 837a8f9e06e141dcbd5f7bd895016d49. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:20:07.278936 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Getting quotas for user c6ba562873fa4f4fbd0b635f1c9dcdf2 and project 837a8f9e06e141dcbd5f7bd895016d49. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:20:07.293725 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] [instance: 6cba399c-58c3-4850-8065-0fbc3301fb2c] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:20:07.295048 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:07.295690 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:07.384832 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] [instance: 6cba399c-58c3-4850-8065-0fbc3301fb2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:20:07.387720 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:07.388513 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:07.801728 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:07.801728 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f8249777-fdbf-44ec-9af0-92211e08c6f8 tempest-ServersTestFqdnHostnames-1193871565 tempest-ServersTestFqdnHostnames-1193871565-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:13.620238 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:13.767154 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:13.866864 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:13.987531 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:14.943856 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=21,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:17.263774 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:17.396224 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=37,nova_cell1:RELEASE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:17.520651 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:17.651834 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:19.197085 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:20:25.010523 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:40.386512 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:20:40.438826 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:40.439934 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:40.732464 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:40.732891 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:40.733628 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:40.734141 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:40.773101 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Getting quotas for project f163566907554620bc94de3b960a4f13. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:20:40.786026 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Getting quotas for user d3bb6f6d546c4bd090e72c149afe5660 and project f163566907554620bc94de3b960a4f13. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:20:40.881002 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] [instance: fa4d69b3-8beb-4dfa-b655-c5c26dcac34f] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:20:40.882224 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:40.884139 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:41.002883 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] [instance: fa4d69b3-8beb-4dfa-b655-c5c26dcac34f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:20:41.009874 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:41.009874 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:41.352236 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:20:41.352897 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-68bca602-ca63-48b1-b45c-e5a1134ee1d1 tempest-ServerPasswordTestJSON-2022348653 tempest-ServerPasswordTestJSON-2022348653-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:20:50.757010 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:51.010853 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:51.163569 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:51.248349 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:54.948043 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:05.008623 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:09.035284 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:21:09.071067 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:09.071930 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:09.388039 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:09.388506 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:09.389246 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:09.389649 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:09.430679 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Getting quotas for project 22ca92a86e6c40d59071e58ce4085568. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:21:09.439190 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Getting quotas for user bba77f6ef42547f1aa8480e27868bd4a and project 22ca92a86e6c40d59071e58ce4085568. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:21:09.470268 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] [instance: f114e124-2903-4f30-b055-9f493e3e9e6c] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:21:09.470268 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:09.470268 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:09.571386 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] [instance: f114e124-2903-4f30-b055-9f493e3e9e6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:21:09.572832 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:09.573498 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:09.853301 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:09.854060 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-d9b73105-244f-4dea-b093-bd08a2ac2ffa tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:19.396302 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:19.578696 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:19.694110 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:19.779811 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:34.942863 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:37.526425 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:21:37.581476 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:37.582193 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:38.133410 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:38.137489 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:38.137907 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:38.138650 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:38.139075 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:38.182948 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Getting quotas for project 3e1f6ffc3fb64dba8c4474641e796fb8. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:21:38.192387 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Getting quotas for user 029f1334779e4bcdb3f4f2aed564a075 and project 3e1f6ffc3fb64dba8c4474641e796fb8. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:21:38.217796 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] [instance: fa075dcc-e175-449a-9914-d1ee19131f33] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:21:38.224796 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:38.225312 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:38.341954 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] [instance: fa075dcc-e175-449a-9914-d1ee19131f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cffbb16d-5cb8-459a-b417-cf170a24beb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:21:38.341954 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:38.342220 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:38.790682 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:38.791413 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-13c85d9b-4e58-4e31-b7de-15e2c4d21f0e tempest-AttachSCSIVolumeTestJSON-288658511 tempest-AttachSCSIVolumeTestJSON-288658511-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:40.849498 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Took 2.08 seconds to select destinations for 3 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:21:40.908400 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:40.908400 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:41.313424 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:41.314744 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:41.659986 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:41.674407 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:41.898311 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:41.899000 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:41.900288 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:41.900700 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:41.927748 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Getting quotas for project c95a2d1e0a034c7ca4a2fcb9fd060d53. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:21:41.934186 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Getting quotas for user fa4c2791e14d4f88883a0af422e4ff0c and project c95a2d1e0a034c7ca4a2fcb9fd060d53. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:21:41.949491 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] [instance: 8acee151-2b52-4ca3-b2e1-18a19834b0e2] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:21:41.951599 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:41.952072 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.019839 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] [instance: 8acee151-2b52-4ca3-b2e1-18a19834b0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:21:42.021520 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.022174 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.392607 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Took 1.15 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:21:42.412098 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.412451 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.437025 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] [instance: 9e7787d1-264a-4707-8604-3e8b70133376] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:21:42.447164 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.447584 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.482936 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.487770 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.581609 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] [instance: 9e7787d1-264a-4707-8604-3e8b70133376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:21:42.582931 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.583378 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.765611 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.765751 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.766578 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.768091 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.801922 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Getting quotas for project 65644a8df5d84df3b35c894560e0a5c4. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:21:42.807535 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Getting quotas for user aaf2292818b749f0ae43c66bca929be9 and project 65644a8df5d84df3b35c894560e0a5c4. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:21:42.821084 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] [instance: 583e0c15-3053-429d-81bf-95a4d1f99cbf] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:21:42.822456 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.823049 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:42.932803 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] [instance: 583e0c15-3053-429d-81bf-95a4d1f99cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:21:42.932803 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:42.932803 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:43.009027 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:43.009027 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:43.036413 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] [instance: 94d9ca2e-1c4d-49ce-918e-02479909b75b] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:21:43.041562 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:43.042370 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:43.178411 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] [instance: 94d9ca2e-1c4d-49ce-918e-02479909b75b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:21:43.182943 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:43.184231 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:43.506224 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:43.507556 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d75aba42-a48d-4f8e-b837-cf60b9d1c9aa tempest-ServerRescueTestJSONUnderV235-139726075 tempest-ServerRescueTestJSONUnderV235-139726075-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:43.794555 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:43.794555 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4bc5c068-3e85-42ec-b4cd-b341fa0ccb15 tempest-ListServersNegativeTestJSON-982002908 tempest-ListServersNegativeTestJSON-982002908-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:51.918501 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:52.794439 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:52.953822 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=21,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=36,nova_cell1:RELEASE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:53.110518 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:53.191910 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=23,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=52,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:53.301192 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:53.458006 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:53.604706 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:54.988837 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Took 1.14 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:21:55.011670 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:55.012668 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:55.356559 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:55.357245 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:55.358323 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:55.361748 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:55.429883 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:21:55.444948 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for user 6f2e974ab5aa48dfb4b00f810dcedb63 and project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:21:55.523831 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: a4f887a4-84e8-4b14-beca-e6ad747ba616] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:21:55.525903 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:55.529705 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:55.609118 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: a4f887a4-84e8-4b14-beca-e6ad747ba616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:21:55.611850 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:55.612281 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:21:55.893546 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:21:55.894295 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-428a3691-1870-46d1-99b6-89054f8bd6f7 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:05.398338 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:06.913609 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:08.612151 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:14.957721 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:15.013723 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=18,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:21.663297 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:22:21.682021 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:21.682437 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:21.863775 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:21.864189 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:21.864952 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:21.865350 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:21.882586 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:22:21.887640 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for user 6f2e974ab5aa48dfb4b00f810dcedb63 and project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:22:21.899503 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 32df0911-cfa6-4410-840a-4098a9fef0b4] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:22:21.900445 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:21.900850 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:22.016092 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 32df0911-cfa6-4410-840a-4098a9fef0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:22:22.017601 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:22.018052 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:22.380639 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:22.381228 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-23fb1693-9df4-419c-ba70-07f17e6e9413 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:31.874254 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:32.022482 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:32.136104 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:32.248626 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:44.963615 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:45.016281 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=11,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:46.969370 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:22:47.001820 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:47.002319 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:47.380556 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:47.381207 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:47.382189 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:47.382891 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:47.417916 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Getting quotas for project 7c0ebaf2e3714e42b3bda726e2133522. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:22:47.427883 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Getting quotas for user 3ab7326ef48042fe961a7eed5c46db24 and project 7c0ebaf2e3714e42b3bda726e2133522. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:22:47.443557 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] [instance: 43a4dc6f-5d4d-45d7-bc69-0c754c2ec27a] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:22:47.445716 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:47.445716 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:47.545484 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] [instance: 43a4dc6f-5d4d-45d7-bc69-0c754c2ec27a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:22:47.547721 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:47.548468 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:47.986596 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:47.987176 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b856901a-1771-4443-be12-123a510773d9 tempest-ServerAddressesNegativeTestJSON-1415290150 tempest-ServerAddressesNegativeTestJSON-1415290150-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:57.395740 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:57.560398 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:57.658294 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:22:57.689091 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:57.689823 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:57.856146 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:57.856569 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:57.857333 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:57.857733 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:57.879670 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:57.879961 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:22:57.881526 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:57.890378 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for user 6f2e974ab5aa48dfb4b00f810dcedb63 and project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:22:57.915434 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: e5d606fa-6108-494c-846f-d40e3273cc64] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:22:57.915812 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:57.916228 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:57.980348 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: e5d606fa-6108-494c-846f-d40e3273cc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:22:57.982431 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:57.982878 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:58.231110 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:58.232402 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:58.473917 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:22:58.475694 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e0f11e0a-30c6-49b8-8621-d708dcf8a915 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:22:58.892300 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:23:01.896788 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:23:01.953912 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:01.954547 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:02.213149 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:02.213845 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:02.214876 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:02.215933 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:02.249309 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:23:02.259313 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for user 6f2e974ab5aa48dfb4b00f810dcedb63 and project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:23:02.277909 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 1cb418f7-6aea-42e6-88a2-007564d925c4] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:23:02.279787 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:02.281124 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:02.382794 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 1cb418f7-6aea-42e6-88a2-007564d925c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:23:02.384969 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:02.384969 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:02.740492 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:02.740818 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6e7dec2a-1957-4a3b-b982-a36b7741945d tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:07.866346 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:08.099575 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:08.229803 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:08.485995 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=17,nova_cell1:UPDATE=12,nova_cell1:DELETE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:12.231621 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:12.392944 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:12.572420 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:12.679939 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:24.978167 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=21,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:25.023104 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:35.276429 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:23:35.301925 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.302662 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:35.489899 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:23:35.503999 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.504759 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:35.505914 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.506517 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:35.511669 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.513642 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:35.524597 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:23:35.530549 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for user 6f2e974ab5aa48dfb4b00f810dcedb63 and project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:23:35.542968 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 8e6eab25-f25e-46a2-9c72-9424c872fb84] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:23:35.544088 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.544765 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:35.627599 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 8e6eab25-f25e-46a2-9c72-9424c872fb84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:23:35.629377 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.630160 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:35.772348 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.774865 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:35.777018 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.780655 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:35.807349 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:23:35.813787 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for user 027dcc48e4fd4c36a5004096ad5e43f8 and project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:23:35.840093 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: e6774019-149e-4804-b0ab-e3fcd137851e] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:23:35.841872 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:35.842444 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:36.030162 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: e6774019-149e-4804-b0ab-e3fcd137851e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:23:36.032002 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:36.033307 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:36.076731 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:36.077157 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-7457c750-39dc-4ed7-aa17-c78ae14c00c8 tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:36.381493 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:36.381921 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75b0d559-6daf-4d3d-a7a6-7cdb1ba4f15f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:39.209397 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:23:45.514596 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:45.634871 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:45.772264 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:45.797567 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:45.848896 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:46.038089 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:46.255666 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:46.257706 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:53.610897 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Took 1.13 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:23:53.670592 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:53.675282 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:53.895130 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:53.896119 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:53.897275 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:53.897847 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:53.930264 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Getting quotas for project da56fc78f06142aba80ca4c6e3d60475. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:23:53.940885 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Getting quotas for user bcc9aa2a091c490599f9a9c41163e2eb and project da56fc78f06142aba80ca4c6e3d60475. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:23:53.974570 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] [instance: 92fbfe5e-07b4-44ec-9729-1a9230f4c02c] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:23:53.976208 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:53.976801 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:54.092314 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] [instance: 92fbfe5e-07b4-44ec-9729-1a9230f4c02c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:23:54.094275 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:54.094853 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:54.423936 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:54.424350 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-60e39fb6-9bcb-4ecd-a847-27b8a1cbe2c9 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:55.881980 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:23:55.938480 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:55.939624 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:56.143061 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:56.145169 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:56.147716 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:56.150843 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:56.238730 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Getting quotas for project da56fc78f06142aba80ca4c6e3d60475. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:23:56.250098 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Getting quotas for user bcc9aa2a091c490599f9a9c41163e2eb and project da56fc78f06142aba80ca4c6e3d60475. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:23:56.273354 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] [instance: 867b2ab0-9301-414b-b045-85057d642971] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:23:56.274645 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:56.275456 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:56.369650 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] [instance: 867b2ab0-9301-414b-b045-85057d642971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:23:56.375776 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:56.376462 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:23:56.738600 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:23:56.739045 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1ee53fbd-4996-4432-8cd5-e49954f771c5 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:03.915367 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:04.098361 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:04.224114 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:04.309853 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:04.976320 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:05.026260 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:05.315802 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:24:05.360566 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:05.361385 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:05.555053 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:05.555705 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:05.559815 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:05.560742 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:05.627701 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:24:05.643300 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for user 027dcc48e4fd4c36a5004096ad5e43f8 and project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:24:05.700540 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: b442581d-3a9f-4a24-9fae-c2abf958b2bd] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:24:05.701843 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:05.702592 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:05.834221 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: b442581d-3a9f-4a24-9fae-c2abf958b2bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:24:05.835826 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:05.836433 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:06.057246 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:06.058900 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:06.212999 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:06.267475 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:06.268654 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d24ee9-5e99-4d70-bc2d-3bb9453db4df tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:06.387450 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:06.642622 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:06.643880 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:09.555242 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:24:09.599299 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:09.602424 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:09.776749 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:09.777369 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:09.779040 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:09.779836 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:09.802705 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:24:09.811130 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for user 027dcc48e4fd4c36a5004096ad5e43f8 and project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:24:09.834459 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: 083a6d48-6623-437b-8649-92a693c68ebf] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:24:09.837816 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:09.838224 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:09.922506 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: 083a6d48-6623-437b-8649-92a693c68ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:24:09.929155 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:09.929155 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:10.215578 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:10.215994 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-29b9053a-31eb-46e6-b7df-1da0f46a701b tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:15.599141 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:16.057200 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:17.457312 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=17,nova_cell1:UPDATE=12,nova_cell1:DELETE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:19.792368 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:19.935306 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:20.104780 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:20.106379 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:24.723823 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:24:24.787052 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:24.787542 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:24.921483 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:24.921901 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:24.925961 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:24.926342 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:24.967423 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Getting quotas for project 22ca92a86e6c40d59071e58ce4085568. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:24:24.983962 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Getting quotas for user bba77f6ef42547f1aa8480e27868bd4a and project 22ca92a86e6c40d59071e58ce4085568. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:24:25.030273 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] [instance: 2fad683a-f21f-4a9c-8323-e9380ef7f9ef] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:24:25.031458 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:25.032131 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:25.166415 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] [instance: 2fad683a-f21f-4a9c-8323-e9380ef7f9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:24:25.168560 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:25.168687 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:25.498458 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:25.498882 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3e8d97b4-8384-4aa9-8716-6a7152841b64 tempest-AttachVolumeTestJSON-1168541016 tempest-AttachVolumeTestJSON-1168541016-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:34.947349 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:35.174007 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:35.278881 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:35.351376 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:37.932184 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:24:37.970844 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:37.971352 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:38.300335 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:38.305966 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:38.305966 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:38.305966 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:38.305966 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:38.343297 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:24:38.356430 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for user 027dcc48e4fd4c36a5004096ad5e43f8 and project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:24:38.385110 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: c9901d0a-8a17-4e6c-ba98-6bd587d410e0] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:24:38.391612 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:38.392491 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:38.565377 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: c9901d0a-8a17-4e6c-ba98-6bd587d410e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:24:38.565377 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:38.565377 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:38.921256 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:38.921791 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-1f642a4b-a912-4b2c-839b-6e06dba4278e tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:45.036686 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:48.325630 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:48.568578 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:48.723456 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:48.809690 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:50.487740 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Took 1.26 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:24:50.530261 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:50.531220 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:50.879654 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:50.880639 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:50.884902 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:50.885608 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:50.920963 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Getting quotas for project 336b3ef8a8744bf3b86854b32000bda6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:24:50.930982 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Getting quotas for user 3b0b46c0c1f74adaaaf65d46db7b2618 and project 336b3ef8a8744bf3b86854b32000bda6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:24:50.944554 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] [instance: f00bea08-4180-45d6-ba01-4b104f5615d6] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:24:50.945732 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:50.946903 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:51.015894 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] [instance: f00bea08-4180-45d6-ba01-4b104f5615d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:24:51.017660 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:51.018351 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:24:51.350226 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:24:51.350648 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-00b65b55-b6c0-448f-bd13-cad487580a7d tempest-ImagesOneServerTestJSON-741929816 tempest-ImagesOneServerTestJSON-741929816-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:00.903899 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:01.022977 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:01.246930 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:01.248158 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:02.511349 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Took 2.15 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:25:02.545664 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:02.546070 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:02.761721 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:02.762134 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:02.762867 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:02.765717 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:02.786715 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Getting quotas for project cfc2e42a0df346f4adef152ba2e3fa71. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:25:02.792775 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Getting quotas for user a23fafbab18d41ee82b84bbdf94cf0fe and project cfc2e42a0df346f4adef152ba2e3fa71. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:25:02.806010 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] [instance: 4eb3d8d6-79ae-4109-a5a7-835c459d1719] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:25:02.807150 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:02.807822 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:02.883840 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] [instance: 4eb3d8d6-79ae-4109-a5a7-835c459d1719] block_device_mapping [BlockDeviceMapping(attachment_id=57944f4e-5a52-4339-b402-d48307b8888f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6c632192-292e-476a-92f7-a3a26a1725e6',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=26444498-4b46-4d27-ab02-230eec120645,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='83999d90-80b2-4c0c-8aff-bec74809b4d9',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=fdd69779-04fa-4ff5-b249-c0c3cfa904e2,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0883a5a-4e31-4e72-9db6-7d56ee50023e',volume_size=1,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:25:02.886374 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:02.886857 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:02.975773 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:02.977765 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:03.074043 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:03.074741 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:03.430999 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:03.431965 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c6df4a88-bc09-479f-b0cf-d5e47766b27f tempest-TaggedBootDevicesTest-1806311997 tempest-TaggedBootDevicesTest-1806311997-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:12.772720 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:13.080544 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=11,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=20,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:13.313003 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:13.336381 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:25:13.358608 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.359221 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.475574 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:25:13.502219 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.502630 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.523402 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.523822 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.525241 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.525651 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.545835 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:25:13.550947 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for user 6f2e974ab5aa48dfb4b00f810dcedb63 and project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:25:13.564235 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 00c8a753-5bf0-448c-8107-3946aa9bf7ae] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:25:13.565061 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.565721 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.624276 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=18,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:13.628172 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.628780 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.629513 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.629901 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.646768 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:25:13.651782 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for user 027dcc48e4fd4c36a5004096ad5e43f8 and project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:25:13.663311 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: 05358d0e-ed2f-443c-835c-f77cd929289e] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:25:13.664755 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.665163 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.666203 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 00c8a753-5bf0-448c-8107-3946aa9bf7ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:25:13.667493 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.667949 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.757087 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: 05358d0e-ed2f-443c-835c-f77cd929289e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:25:13.758567 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.759487 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:13.901848 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:13.902263 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d0c11e0-f010-46d0-9a6f-e6a0847e5fdb tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:14.019330 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:14.019903 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4e053337-103e-4846-a083-11bcdd214d64 tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:23.538370 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.671534 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.770436 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.846036 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.873326 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.928466 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:25.044591 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:26.831868 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:36.469983 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:25:36.492127 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:36.494196 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:36.671134 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:36.671539 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:36.672462 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:36.673026 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:36.690472 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:25:36.695897 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for user 027dcc48e4fd4c36a5004096ad5e43f8 and project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:25:36.707554 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: c20f3279-68ae-4b04-8b87-cc16e5f73f1e] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:25:36.708486 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:36.708890 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:36.785934 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: c20f3279-68ae-4b04-8b87-cc16e5f73f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:25:36.787223 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:36.787624 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:37.066732 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:37.067107 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c0c0aaf7-16b7-4d0b-84d4-a409aaa5388f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:39.448650 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:25:39.491024 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:39.491730 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:39.681894 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:39.682824 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:39.684288 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:39.684869 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:39.709158 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Getting quotas for project da56fc78f06142aba80ca4c6e3d60475. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:25:39.721071 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Getting quotas for user bcc9aa2a091c490599f9a9c41163e2eb and project da56fc78f06142aba80ca4c6e3d60475. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:25:39.734966 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] [instance: c2e32bd9-9d80-427b-bb6d-6274fd48173a] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:25:39.736591 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:39.743902 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:39.828665 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] [instance: c2e32bd9-9d80-427b-bb6d-6274fd48173a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:25:39.832411 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:39.833042 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:40.143163 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:25:40.143918 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fbcc172e-bf60-458f-bba8-72371f873403 tempest-ServerRescueNegativeTestJSON-439221844 tempest-ServerRescueNegativeTestJSON-439221844-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:25:46.682303 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:46.792555 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:46.970911 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:46.971976 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:49.698664 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:49.840074 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:49.950932 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:50.023682 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:54.970576 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:05.043347 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:14.979929 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:18.825275 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:26:18.853193 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:18.855406 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:18.901015 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:26:19.000678 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:19.001093 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:19.002288 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:19.002700 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:19.040162 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:26:19.047432 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Getting quotas for user 6f2e974ab5aa48dfb4b00f810dcedb63 and project d31be8475a6a49d6bfe8132dd050c6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:26:19.061166 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 6ba66466-0da7-4e8d-8ddd-b46f582713fc] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:26:19.062387 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:19.063143 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:19.163063 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] [instance: 6ba66466-0da7-4e8d-8ddd-b46f582713fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:26:19.166222 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:19.170243 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:19.648245 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:19.648661 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-662ddbd9-9ca3-44ff-bf75-7eecede38e9a tempest-DeleteServersTestJSON-1541892181 tempest-DeleteServersTestJSON-1541892181-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:19.858919 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:26:19.896742 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:19.897356 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:20.165132 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:20.166281 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:20.167922 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:20.168787 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:20.190917 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:26:20.196163 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for user 027dcc48e4fd4c36a5004096ad5e43f8 and project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:26:20.231569 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: 6dcb4587-0e15-4a2d-b8f0-70b459fb6664] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:26:20.232528 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:20.232932 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:20.355698 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: 6dcb4587-0e15-4a2d-b8f0-70b459fb6664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:26:20.357502 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:20.358212 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:20.625472 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:20.626051 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9b1-a1fd-4a27-86d0-a353bb0c4cee tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:22.312005 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:26:22.395304 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:22.395639 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:22.712309 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:22.713999 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:22.719870 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:22.725397 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:22.761503 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Getting quotas for project 8f2736abb6094c1f83a7aa3efc772506. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:26:22.774197 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Getting quotas for user 1963f7b0ee0244b2b4f5fc1d8b34f858 and project 8f2736abb6094c1f83a7aa3efc772506. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:26:22.813332 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] [instance: ae4b76bc-e7bd-45ff-8716-361dcbbfaa1d] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:26:22.814570 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:22.819372 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:22.921114 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] [instance: ae4b76bc-e7bd-45ff-8716-361dcbbfaa1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:26:22.922824 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:22.923525 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:23.185571 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:23.186144 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-39988d9c-e80c-4e05-8cec-5fcf8193749d tempest-InstanceActionsNegativeTestJSON-904555896 tempest-InstanceActionsNegativeTestJSON-904555896-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:27.806510 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:26:27.837128 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:27.837577 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:28.090689 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:28.091474 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:28.094911 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:28.094911 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:28.110539 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Getting quotas for project 7d5a798ee507429bb70566356229535d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:26:28.118880 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Getting quotas for user bb1f6532421745a4b0de70356748a647 and project 7d5a798ee507429bb70566356229535d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:26:28.133419 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] [instance: 9a184cb7-2548-41d5-8d37-8e72dfb3d75a] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:26:28.134500 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:28.134852 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:28.235493 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] [instance: 9a184cb7-2548-41d5-8d37-8e72dfb3d75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:26:28.237946 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:28.239106 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:28.554477 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:28.554898 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-902476ec-d59f-4052-9e97-7eb934b45ed5 tempest-VolumesBackupsTest-1570956956 tempest-VolumesBackupsTest-1570956956-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:32.737109 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:32.929871 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=35,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:33.024917 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:33.129819 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:38.101626 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:38.243815 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=35,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:38.364189 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:38.461285 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:45.040868 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:46.512687 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:26:46.551621 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:46.552038 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:46.728095 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:46.728247 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:46.728961 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:46.729486 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:46.748614 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:26:46.753604 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Getting quotas for user 027dcc48e4fd4c36a5004096ad5e43f8 and project 1dad823e240149edb30e592380249a13. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:26:46.766013 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: a45c5bbd-ab66-426a-8e31-f471ce68606f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:26:46.766950 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:46.767386 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:46.874401 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] [instance: a45c5bbd-ab66-426a-8e31-f471ce68606f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:26:46.876728 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:46.876829 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:47.133558 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:47.133973 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4f64e527-9405-4de3-bc3d-e8f3d72b566f tempest-ServersTestJSON-1529284206 tempest-ServersTestJSON-1529284206-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:54.986232 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=21,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:56.741262 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:56.882148 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:56.983228 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:57.060878 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:58.052788 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:26:58.115647 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:58.119690 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:58.465742 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:58.465742 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:58.466354 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:58.466877 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:58.498279 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Getting quotas for project 3b214f5044c7445592e177835a5d18fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:26:58.505347 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Getting quotas for user 029c76a0ba614b5880128c4309902c67 and project 3b214f5044c7445592e177835a5d18fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:26:58.518100 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] [instance: cf38328b-40fb-4537-b524-aaeb0a0abfb4] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:26:58.523768 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:58.523768 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:58.617168 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] [instance: cf38328b-40fb-4537-b524-aaeb0a0abfb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:26:58.618482 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:58.618886 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:58.922883 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:58.926873 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-27de9325-8a22-495c-9793-b287fb007673 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:59.199057 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:26:59.227644 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:26:59.264556 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:59.265490 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:59.543225 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:59.543644 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:59.545199 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:59.545666 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:59.567207 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Getting quotas for project 3b214f5044c7445592e177835a5d18fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:26:59.573520 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Getting quotas for user 029c76a0ba614b5880128c4309902c67 and project 3b214f5044c7445592e177835a5d18fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:26:59.605781 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] [instance: b01533f3-9a31-4246-b3e7-f12f638e8e89] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:26:59.606945 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:59.609030 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:26:59.748702 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] [instance: b01533f3-9a31-4246-b3e7-f12f638e8e89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:26:59.750310 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:26:59.750943 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:00.150277 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:00.150681 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-547cce8e-74ab-4795-9117-e60e04cbd418 tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:00.885867 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:27:00.953115 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:00.953531 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:01.201342 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:01.203617 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:01.208140 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:01.211553 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:01.250936 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Getting quotas for project 3b214f5044c7445592e177835a5d18fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:27:01.259386 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Getting quotas for user 029c76a0ba614b5880128c4309902c67 and project 3b214f5044c7445592e177835a5d18fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:27:01.296545 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] [instance: fbb7fab1-a4d5-48e2-9ace-fc65fad094ce] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:27:01.296545 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:01.296545 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:01.367675 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] [instance: fbb7fab1-a4d5-48e2-9ace-fc65fad094ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:27:01.369134 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:01.369545 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:01.790119 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:01.790578 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4d89632f-4960-4192-8259-a2644018bc1b tempest-ListServerFiltersTestJSON-921481021 tempest-ListServerFiltersTestJSON-921481021-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:09.559255 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:09.757457 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:09.920231 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:10.033618 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:11.228082 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:11.381488 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=35,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:11.515197 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:11.691256 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:19.892631 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:27:19.926728 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:19.927418 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:20.255070 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:20.257461 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:20.257874 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:20.258608 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:20.260467 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:20.283650 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Getting quotas for project aef73d309b204eeebfc2ce69b4e4a41b. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:27:20.289988 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Getting quotas for user 45315c12d53349ae8cd245cb138b8dcd and project aef73d309b204eeebfc2ce69b4e4a41b. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:27:20.309707 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] [instance: fbc2a45b-c662-475e-936d-70697843ce90] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:27:20.310816 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:20.311435 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:20.431849 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] [instance: fbc2a45b-c662-475e-936d-70697843ce90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:27:20.433103 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:20.433515 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:20.875489 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:20.875901 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3cab0e7f-2b34-4f7b-b098-1b9a95589597 tempest-InstanceActionsV221TestJSON-1929810395 tempest-InstanceActionsV221TestJSON-1929810395-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:30.271815 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:30.437293 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:30.790471 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:30.798476 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:35.000563 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=19,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:38.699863 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:27:38.742669 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:38.743262 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:39.021447 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:39.021793 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:39.023547 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:39.026525 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:39.076443 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Getting quotas for project 5bfd328e0f1446369531a23d15387cd6. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:27:39.083951 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Getting quotas for user 6771589864f442cbbfc8abf018abbd09 and project 5bfd328e0f1446369531a23d15387cd6. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:27:39.099326 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] [instance: 0b67ad87-5ea8-4837-90f8-b3bc99134f3b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:27:39.100746 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:39.101431 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:39.175959 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] [instance: 0b67ad87-5ea8-4837-90f8-b3bc99134f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:27:39.179191 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:39.179975 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:39.446218 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:27:39.446627 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c5b786e6-724a-45b2-8f3c-5f426fdc7f74 tempest-VolumesNegativeTest-1381254418 tempest-VolumesNegativeTest-1381254418-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:27:45.041242 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:49.054577 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:49.184293 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:49.288409 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:49.366249 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:06.379896 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:28:06.450991 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:06.451506 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:06.792389 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:06.793482 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:06.797653 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:06.798339 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:06.835557 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Getting quotas for project 349811967f4b4d1a9ab6772602a205a6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:28:06.864625 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Getting quotas for user 0f14ac04b7a44f17b946c5c8619554ad and project 349811967f4b4d1a9ab6772602a205a6. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:28:06.903827 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] [instance: 93519c14-aee1-4da1-8cce-775e0ad268dc] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:28:06.911146 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:06.914256 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:07.016311 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] [instance: 93519c14-aee1-4da1-8cce-775e0ad268dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:28:07.017843 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:07.018627 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:07.303785 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:07.305264 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-b9c5c888-c89e-4f01-982f-657f668081f6 tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:15.012537 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:15.744135 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f789b780-6312-4f08-ab3a-911b4d4aefdc tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:28:15.748622 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f789b780-6312-4f08-ab3a-911b4d4aefdc tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:15.749060 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f789b780-6312-4f08-ab3a-911b4d4aefdc tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:15.853586 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f789b780-6312-4f08-ab3a-911b4d4aefdc tempest-ServerShowV254Test-1871809174 tempest-ServerShowV254Test-1871809174-project] [instance: 93519c14-aee1-4da1-8cce-775e0ad268dc] No migration record for the rebuild/evacuate request. {{(pid=129815) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:28:16.821619 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:17.024185 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:17.142599 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:17.226078 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:22.608402 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:28:22.641542 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:22.642053 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:22.892514 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:22.896260 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:22.896672 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:22.897405 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:22.897800 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:22.925078 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Getting quotas for project e451ee7bfd2d4ab58d30c33fef334b55. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:28:22.930989 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Getting quotas for user ca2c9e7e6d61414cbf2c7e17753bc0df and project e451ee7bfd2d4ab58d30c33fef334b55. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:28:22.946364 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] [instance: 08a33911-6e47-45fd-b499-155f199aacf8] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:28:22.947333 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:22.947915 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:23.054448 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] [instance: 08a33911-6e47-45fd-b499-155f199aacf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:28:23.056152 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:23.056569 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:23.382620 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:23.383240 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5db7f178-68ed-4bdf-af71-c12f1c4f59f4 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:25.742954 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:25.889925 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:26.088499 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:32.915406 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:33.060435 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:33.159848 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:33.270778 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:35.011161 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:37.320653 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:28:37.350918 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:37.351563 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:37.705436 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:37.705849 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:37.706586 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:37.706988 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:37.753110 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Getting quotas for project 125617442dae45f58c179b625bcc799d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:28:37.758718 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Getting quotas for user a27b3e9973c846c68f25f7981c995b73 and project 125617442dae45f58c179b625bcc799d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:28:37.772097 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] [instance: 138c70ad-acc1-4ce6-bb22-72d3d23175b1] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:28:37.778118 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:37.778532 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:37.837335 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] [instance: 138c70ad-acc1-4ce6-bb22-72d3d23175b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:28:37.838702 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:37.839377 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:38.274913 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:38.274913 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-2818b792-4d04-4b09-b1b0-717e2844c074 tempest-ServerAddressesTestJSON-1664683043 tempest-ServerAddressesTestJSON-1664683043-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:45.049293 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:47.733314 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:47.844239 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:48.129618 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:48.143839 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:56.592911 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:28:56.643732 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:56.645401 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:56.873903 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:56.874322 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:56.875091 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:56.875496 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:56.894132 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Getting quotas for project 3c6f089da37e4ff09784a2b42513ff36. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:28:56.901951 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Getting quotas for user af0cd3652c8d42bcb8af08852ff4f203 and project 3c6f089da37e4ff09784a2b42513ff36. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:28:56.944036 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] [instance: fed8328c-f9d3-4f4a-97c9-4919a94e6106] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:28:56.945312 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:56.946007 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:57.094204 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] [instance: fed8328c-f9d3-4f4a-97c9-4919a94e6106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:28:57.096917 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:57.097502 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:57.524075 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:57.524499 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6d46d8b0-219b-4254-bb67-e116949ae187 tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:57.926131 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:28:57.951917 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:57.952334 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:58.254700 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:58.255258 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:58.256109 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:58.256577 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:58.272718 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Getting quotas for project bed7c94624484c7cb8abeb3bfc8757b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:28:58.277997 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Getting quotas for user 4ddfae3448704591b662de83b97a1876 and project bed7c94624484c7cb8abeb3bfc8757b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:28:58.294554 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] [instance: 59a4c34e-3184-465b-b14c-0ad55192c8ce] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:28:58.299535 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:58.300170 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:58.477492 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] [instance: 59a4c34e-3184-465b-b14c-0ad55192c8ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:28:58.478983 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:58.487075 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:28:58.946565 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:28:58.947893 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3a373348-1838-4baa-b9fc-715b4126c2aa tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:29:04.514762 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-76efa57b-b317-4262-bf07-cff4cc7108ab tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:29:04.515396 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-76efa57b-b317-4262-bf07-cff4cc7108ab tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:29:04.516010 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-76efa57b-b317-4262-bf07-cff4cc7108ab tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:29:04.613522 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-76efa57b-b317-4262-bf07-cff4cc7108ab tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] [instance: fed8328c-f9d3-4f4a-97c9-4919a94e6106] No migration record for the rebuild/evacuate request. {{(pid=129816) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:29:04.619255 ncdv-master-1 nova-conductor[129816]: ERROR oslo.messaging._drivers.impl_rabbit [None req-76efa57b-b317-4262-bf07-cff4cc7108ab tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] [add4ccaa-23dd-4295-8f26-8361c79e5174] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 16 21:29:05.627876 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [None req-76efa57b-b317-4262-bf07-cff4cc7108ab tempest-ServerShowV257Test-409263129 tempest-ServerShowV257Test-409263129-project] [add4ccaa-23dd-4295-8f26-8361c79e5174] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54916. Jul 16 21:29:06.883396 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:08.263800 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:08.485643 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:08.628258 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:08.763825 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:14.507505 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:15.013397 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=21,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:15.641189 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:15.694661 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=16,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=19,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:25.052201 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:45.071444 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:29:45.118728 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:29:45.121373 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:29:45.436015 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:29:45.436617 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:29:45.437518 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:29:45.438064 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:29:45.488222 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Getting quotas for project 207ec2d1883c4a1ba89696e6e77cf3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:29:45.498148 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Getting quotas for user da77ec3d0f04496d8c8df4025bba76d1 and project 207ec2d1883c4a1ba89696e6e77cf3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:29:45.546586 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] [instance: 515fd3da-3965-4882-b9e8-100a7eea64d9] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:29:45.551213 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:29:45.551694 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:29:45.687234 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] [instance: 515fd3da-3965-4882-b9e8-100a7eea64d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:29:45.688855 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:29:45.689670 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:29:46.008707 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:29:46.009369 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-046c3b16-42c5-4769-b445-492c4b8ad334 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:29:55.020493 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:55.459815 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:55.695163 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:55.912138 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:55.913231 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:05.060907 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:05.633191 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-9815d312-f70d-4dd6-9156-faf56f2a9989 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method unshelve_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:30:05.633699 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-9815d312-f70d-4dd6-9156-faf56f2a9989 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:05.634106 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-9815d312-f70d-4dd6-9156-faf56f2a9989 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:06.735574 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-9815d312-f70d-4dd6-9156-faf56f2a9989 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] [instance: 08a33911-6e47-45fd-b499-155f199aacf8] Requesting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) during scheduling {{(pid=129816) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:929}} Jul 16 21:30:07.957218 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-9815d312-f70d-4dd6-9156-faf56f2a9989 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Took 1.22 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:30:07.966636 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-9815d312-f70d-4dd6-9156-faf56f2a9989 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lazy-loading 'flavor' on Instance uuid 08a33911-6e47-45fd-b499-155f199aacf8 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:30:11.844725 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:30:11.916641 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:11.917417 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:12.101348 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:12.102032 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:12.103835 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:12.105331 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:12.133381 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Getting quotas for project bed7c94624484c7cb8abeb3bfc8757b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:30:12.150114 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Getting quotas for user 4ddfae3448704591b662de83b97a1876 and project bed7c94624484c7cb8abeb3bfc8757b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:30:12.185340 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] [instance: d17892b8-b5bd-469e-9284-0abb3115daaa] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:30:12.185340 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:12.188679 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:12.269275 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] [instance: d17892b8-b5bd-469e-9284-0abb3115daaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:30:12.270497 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:12.271203 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:12.579431 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:12.579845 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-226ff859-8864-4380-9dd3-42db775be95e tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:16.729162 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:17.962275 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:18.044290 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:19.239895 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:30:22.123960 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:22.176291 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:22.276010 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:22.496652 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:25.038001 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=11,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:35.064783 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:39.738073 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:30:39.787681 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:39.788472 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:40.096795 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:40.097279 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:40.098094 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:40.098721 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:40.119553 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Getting quotas for project 207ec2d1883c4a1ba89696e6e77cf3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:30:40.125292 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Getting quotas for user da77ec3d0f04496d8c8df4025bba76d1 and project 207ec2d1883c4a1ba89696e6e77cf3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:30:40.139116 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] [instance: 4fa0664b-97f0-44ab-9823-a3a92c1bfdb8] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:30:40.142290 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:40.148339 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:40.301809 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] [instance: 4fa0664b-97f0-44ab-9823-a3a92c1bfdb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:30:40.310815 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:40.313476 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:40.841342 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:30:40.842035 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-820f8b84-1558-40af-a2a5-79d2863fc785 tempest-ServerRescueTestJSON-975252187 tempest-ServerRescueTestJSON-975252187-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:30:50.108521 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:50.326119 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:50.653949 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=10 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:50.654894 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:03.645944 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Took 0.94 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:31:03.707626 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:03.708039 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:04.074313 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:04.082801 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:04.083304 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:04.084352 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:04.084758 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:04.143096 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Getting quotas for project 1e8c65e58fac42c4bd7f49eaa3a14115. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:31:04.166181 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Getting quotas for user 1006989e743247bdb29a51b3a634afd9 and project 1e8c65e58fac42c4bd7f49eaa3a14115. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:31:04.204958 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] [instance: 3aa4786f-20b7-4123-a231-d3d1c3b91b3b] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:31:04.205935 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:04.206349 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:04.280528 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] [instance: 3aa4786f-20b7-4123-a231-d3d1c3b91b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:31:04.281920 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:04.286204 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:04.721835 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:04.723576 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7897ff52-6a5e-4f3a-bc2d-29cb9ea6d99e tempest-TestServerAdvancedOps-475632099 tempest-TestServerAdvancedOps-475632099-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:14.110901 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:14.298769 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:14.469083 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:14.611602 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:15.065427 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:18.913111 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:31:42.502106 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:31:42.582231 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:42.583058 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:42.792952 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:42.793668 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:42.794641 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:42.795345 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:42.849243 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Getting quotas for project e451ee7bfd2d4ab58d30c33fef334b55. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:31:42.855205 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Getting quotas for user ca2c9e7e6d61414cbf2c7e17753bc0df and project e451ee7bfd2d4ab58d30c33fef334b55. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:31:42.878001 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] [instance: 8b77de54-4c8b-4ed5-84f5-68bf69f9809f] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:31:42.879404 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:42.879809 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:42.963816 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] [instance: 8b77de54-4c8b-4ed5-84f5-68bf69f9809f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:31:42.968388 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:42.968388 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:43.303317 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:43.303746 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-105a4e1f-f7d0-40a7-b203-ca77d97960f8 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:45.044784 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:52.816451 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:52.970110 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:53.127442 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:53.220113 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:55.063468 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:58.199507 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:31:58.227206 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:58.229821 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:58.476486 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:58.477188 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:58.478348 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:58.479289 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:58.519619 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Getting quotas for project bed7c94624484c7cb8abeb3bfc8757b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:31:58.528594 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Getting quotas for user 4ddfae3448704591b662de83b97a1876 and project bed7c94624484c7cb8abeb3bfc8757b9. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:31:58.565483 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] [instance: 88cf13fc-0fa3-4e1e-9d76-db4d93b49faf] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:31:58.568769 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:58.570083 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:58.700677 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] [instance: 88cf13fc-0fa3-4e1e-9d76-db4d93b49faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:31:58.700677 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:58.700677 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:31:59.060716 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:31:59.061430 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-ec11b6ec-2f2c-4f9b-8d91-fad968fba879 tempest-TestNetworkBasicOps-590553405 tempest-TestNetworkBasicOps-590553405-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:08.496004 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:08.701447 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:08.841333 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:08.954770 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:19.850872 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:32:19.909148 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:19.910215 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:20.169010 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:20.169419 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:20.170511 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:20.180975 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:20.235290 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Getting quotas for project 367c69301e6a44419af5c2d28b616b80. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:32:20.247459 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Getting quotas for user 08abcba4284e434680ee4640f1541cf9 and project 367c69301e6a44419af5c2d28b616b80. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:32:20.275024 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] [instance: 63bbc7c6-1f26-4d17-bc3e-01f31f1fa939] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:32:20.278429 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:20.278844 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:20.423563 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] [instance: 63bbc7c6-1f26-4d17-bc3e-01f31f1fa939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:32:20.423563 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:20.423563 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:20.870259 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:20.870259 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cd04467-04f5-4865-bd10-5aa8adc2a3c2 tempest-ServerTagsTestJSON-911661735 tempest-ServerTagsTestJSON-911661735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:25.050832 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:30.207795 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:30.432292 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:30.630640 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:30.718677 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:35.070715 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:36.016397 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:32:36.059034 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:36.059438 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:36.390728 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:36.396438 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:36.397583 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:36.399554 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:36.455298 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Getting quotas for project ce30584a7dfa4ab19de73aa8b18b113b. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:32:36.462331 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Getting quotas for user 4fa446573f7d42de816280280c3dec19 and project ce30584a7dfa4ab19de73aa8b18b113b. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:32:36.478244 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] [instance: 3c0f0855-7a9c-4d8a-95ac-3bf41d32d4e6] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:32:36.480016 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:36.480849 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:36.591468 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] [instance: 3c0f0855-7a9c-4d8a-95ac-3bf41d32d4e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:32:36.592727 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:36.593301 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:36.916641 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:32:36.917210 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f23d926c-63e4-41d3-ab6b-756f87861ad1 tempest-TestServerBasicOps-921841537 tempest-TestServerBasicOps-921841537-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:32:46.444564 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:46.474296 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=7 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:46.617227 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=21,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:46.806677 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:05.052665 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:09.854957 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Took 1.04 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:33:09.909943 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:09.910987 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:10.217652 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:10.228075 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:10.228956 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:10.229890 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:10.235846 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:10.290794 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Getting quotas for project da2248fa190342f0bfe9211cae1e403b. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:33:10.302041 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Getting quotas for user 22e264440fff43cdb7be6702839af37f and project da2248fa190342f0bfe9211cae1e403b. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:33:10.338362 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] [instance: e4c7a9cb-e55d-4819-9885-2e72deffddb1] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:33:10.339888 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:10.341449 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:10.443288 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] [instance: e4c7a9cb-e55d-4819-9885-2e72deffddb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:33:10.444902 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:10.445481 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:10.832426 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:10.833517 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5420884-c442-465a-a09c-1aaf2846716d tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:20.263794 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:20.449193 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:20.658488 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:20.743844 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:33.579628 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:33:33.609594 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:33.610068 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:33.762130 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:33.762130 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:33.762130 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:33.762130 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:33.807586 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Getting quotas for project da2248fa190342f0bfe9211cae1e403b. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:33:33.817959 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Getting quotas for user 22e264440fff43cdb7be6702839af37f and project da2248fa190342f0bfe9211cae1e403b. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:33:33.854805 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] [instance: c77c9a95-ea71-40d7-b7a7-ded612d194da] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:33:33.855931 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:33.856361 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:33.958319 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] [instance: c77c9a95-ea71-40d7-b7a7-ded612d194da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:33:33.962864 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:33.963769 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:34.316847 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:34.317623 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-76eef61c-875f-4f1b-8ce2-ac526177c388 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:35.076633 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:39.249322 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:33:41.943555 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-20f00d20-d267-4626-b414-d4881a3333f5 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method unshelve_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:33:41.944228 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-20f00d20-d267-4626-b414-d4881a3333f5 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:33:41.951684 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-20f00d20-d267-4626-b414-d4881a3333f5 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:33:42.353815 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-20f00d20-d267-4626-b414-d4881a3333f5 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] [instance: 8b77de54-4c8b-4ed5-84f5-68bf69f9809f] Requesting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) during scheduling {{(pid=129816) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:929}} Jul 16 21:33:42.930618 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-20f00d20-d267-4626-b414-d4881a3333f5 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:33:42.943454 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-20f00d20-d267-4626-b414-d4881a3333f5 tempest-AttachVolumeShelveTestJSON-2044012735 tempest-AttachVolumeShelveTestJSON-2044012735-project] Lazy-loading 'flavor' on Instance uuid 8b77de54-4c8b-4ed5-84f5-68bf69f9809f {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:33:43.778962 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:43.979236 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:44.065818 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:44.155412 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:45.056261 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:52.349836 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:52.935069 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:52.994030 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:55.084048 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:05.071509 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:18.535282 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:34:35.080787 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:35.095306 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:38.921684 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:34:55.106939 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:15.079600 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:18.475285 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-bdfa2779-b508-4d6f-80c1-32eefbf56aa3 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method unshelve_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:35:18.475784 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-bdfa2779-b508-4d6f-80c1-32eefbf56aa3 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:18.476322 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-bdfa2779-b508-4d6f-80c1-32eefbf56aa3 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:18.509223 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Took 1.46 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:35:18.533259 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:18.533587 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:18.785915 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:18.786847 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:18.788100 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:18.789766 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:18.814574 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Getting quotas for project 0fd0ce287cb44cd59045868ce688909a. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:35:18.825641 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Getting quotas for user 726b46c54e9541fbb7825607bac3abe5 and project 0fd0ce287cb44cd59045868ce688909a. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:35:18.843697 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] [instance: 19df5c33-44d4-4de9-947b-4707b78af23a] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:35:18.845030 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:18.845464 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:18.945950 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] [instance: 19df5c33-44d4-4de9-947b-4707b78af23a] block_device_mapping [BlockDeviceMapping(attachment_id=1fcc5b3b-78e8-423c-83fb-c7909a8cb869,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='048fbb68-c884-46b4-aa78-58477a185196',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=09ae566c-5d70-49de-a3f7-90442985a5b5,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c4869fe9-11ee-40cf-8401-386b1a3bec57',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=a1f1d8c1-96b1-4770-849b-068587bd42ca,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35056502-3c4b-4440-9da4-2bbf9347f08f',volume_size=1,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:35:18.947834 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:18.948250 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:19.032177 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:19.032961 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:19.119137 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:19.119609 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:19.148991 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-bdfa2779-b508-4d6f-80c1-32eefbf56aa3 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] [instance: e4c7a9cb-e55d-4819-9885-2e72deffddb1] Requesting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) during scheduling {{(pid=129816) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:929}} Jul 16 21:35:19.653342 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:19.653342 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 tempest-TaggedBootDevicesTest_v242-896656767 tempest-TaggedBootDevicesTest_v242-896656767-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:19.785491 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-bdfa2779-b508-4d6f-80c1-32eefbf56aa3 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:35:19.805647 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-bdfa2779-b508-4d6f-80c1-32eefbf56aa3 tempest-ServersNegativeTestJSON-1102403437 tempest-ServersNegativeTestJSON-1102403437-project] Lazy-loading 'flavor' on Instance uuid e4c7a9cb-e55d-4819-9885-2e72deffddb1 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:35:25.114981 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:28.801524 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:29.135922 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=11,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=20,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:29.152747 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:29.351365 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:29.493111 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:29.804994 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:29.839324 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:39.339171 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:35:39.365770 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:39.366118 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:39.604459 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:39.605546 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:39.606368 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:39.606862 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:39.625518 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Getting quotas for project e60c0863dc6f4313bdc873fda27ae2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:35:39.631716 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Getting quotas for user 0ab8b3f06e994bbca5d6dd14109bfe50 and project e60c0863dc6f4313bdc873fda27ae2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:35:39.644568 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] [instance: 4df09776-dc3c-46ff-9e64-e20b5d4679fa] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:35:39.645633 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:39.646273 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:39.886610 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] [instance: 4df09776-dc3c-46ff-9e64-e20b5d4679fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:35:39.887916 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:39.888322 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:40.113429 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:35:40.113847 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-8cac2dbc-b990-4143-aa96-be4acb2d069c tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:35:49.614308 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:49.893037 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:49.984427 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:50.055936 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:55.080883 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:05.110208 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:25.122254 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:35.090376 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:42.010423 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:36:42.033650 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:36:42.034064 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:36:42.291936 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:36:42.292523 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:36:42.293728 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:36:42.294026 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:36:42.320259 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Getting quotas for project e60c0863dc6f4313bdc873fda27ae2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:36:42.326625 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Getting quotas for user 0ab8b3f06e994bbca5d6dd14109bfe50 and project e60c0863dc6f4313bdc873fda27ae2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:36:42.341394 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] [instance: a8f70d9d-86c1-469f-bb32-a37c680cc80c] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:36:42.342284 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:36:42.342703 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:36:42.461684 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] [instance: a8f70d9d-86c1-469f-bb32-a37c680cc80c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:36:42.464894 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:36:42.466215 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:36:42.803050 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:36:42.804056 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-094d8730-f876-490f-8ed1-785245053419 tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:36:52.303353 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:52.471925 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:52.685947 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:52.686828 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:59.258607 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:37:05.131598 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:15.085550 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:38.547475 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:37:45.137027 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:51.173842 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Took 2.56 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:37:51.200397 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:37:51.205630 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:37:51.363236 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:51.367262 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:37:51.368466 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:37:51.369529 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:37:51.370078 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:37:51.388128 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Getting quotas for project e60c0863dc6f4313bdc873fda27ae2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:37:51.393715 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Getting quotas for user 0ab8b3f06e994bbca5d6dd14109bfe50 and project e60c0863dc6f4313bdc873fda27ae2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:37:51.405842 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] [instance: a7f9caa9-fff2-44b2-871d-7e4191ff39e5] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:37:51.406794 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:37:51.407309 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:37:51.541719 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] [instance: a7f9caa9-fff2-44b2-871d-7e4191ff39e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:37:51.542981 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:37:51.543408 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:37:51.920432 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:37:51.920851 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36d09c74-9c09-4260-ad9c-ae729e8fd88f tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:37:58.932531 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:38:01.379265 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:01.547408 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:01.787034 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:01.796375 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:17.021815 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:38:17.081262 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:17.081818 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:17.294078 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:17.297651 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:17.298068 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:17.298804 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:17.299480 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:17.318278 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Getting quotas for project 56b8099d9406431284b4dd58b5c16359. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:38:17.324313 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Getting quotas for user 95cd6b54d8164de1a524b407a1852ebd and project 56b8099d9406431284b4dd58b5c16359. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:38:17.343641 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] [instance: 21fc83e5-8f03-4930-93b1-0196f7327b3e] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:38:17.344964 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:17.345639 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:17.404554 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] [instance: 21fc83e5-8f03-4930-93b1-0196f7327b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:38:17.405998 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:17.406610 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:17.696196 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:17.696921 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e5de2c65-6892-467d-8fb7-2697999f4264 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:25.087279 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:27.311854 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:27.411989 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:27.496655 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:27.614798 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:35.130732 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:36.715978 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:38:36.750056 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:36.750476 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:37.097104 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:37.097518 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:37.098253 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:37.098652 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:37.146344 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Getting quotas for project 77c9b7e351e24dc88207e9498f75f578. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:38:37.158178 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Getting quotas for user 833136cbdeab4b9e8b6dd2d24c7c8753 and project 77c9b7e351e24dc88207e9498f75f578. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:38:37.214346 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 2ce56b72-9fe8-41ca-bd6e-31591ef3b494] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:38:37.215629 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:37.216195 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:37.302747 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 2ce56b72-9fe8-41ca-bd6e-31591ef3b494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:38:37.304312 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:37.305790 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:37.699447 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:37.699856 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-6eab712d-f9c4-4f26-ab6c-2432edafb362 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:47.124336 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:47.312916 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:47.617751 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:47.618609 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:59.053702 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:38:59.074899 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:59.078820 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:59.341939 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:59.342353 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:59.343128 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:59.343532 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:59.369272 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Getting quotas for project b533f85aeddf4d8db05f2c53a61befc3. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:38:59.374644 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Getting quotas for user 62209b9802ab46c3b3d094d4d1ad86fe and project b533f85aeddf4d8db05f2c53a61befc3. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:38:59.387227 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] [instance: 8f28a606-c8d6-44cf-89d8-d856f3e8cfea] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:38:59.388200 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:59.388605 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:59.484041 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] [instance: 8f28a606-c8d6-44cf-89d8-d856f3e8cfea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1271e76a-1165-49b4-b725-7079124c1d75',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:38:59.485308 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:59.485707 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:38:59.742075 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:38:59.742529 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-329a9f89-7bed-40f7-95f5-87457a7e7941 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:39:05.090281 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:09.355318 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:09.490603 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=16,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:09.610599 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:09.687678 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:15.147369 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:25.097756 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:32.088799 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9599e2d3-f18f-4d8a-8cf7-b893d1489290 tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:39:32.088799 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9599e2d3-f18f-4d8a-8cf7-b893d1489290 tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:39:32.088799 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9599e2d3-f18f-4d8a-8cf7-b893d1489290 tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:39:32.382811 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-9599e2d3-f18f-4d8a-8cf7-b893d1489290 tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] [instance: 2ce56b72-9fe8-41ca-bd6e-31591ef3b494] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129815) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 21:39:32.875035 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-9599e2d3-f18f-4d8a-8cf7-b893d1489290 tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Created allocations for migration c8ae32bd-eca3-474c-b0d2-0ad3358acb6a on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129815) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:39:33.244976 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-9599e2d3-f18f-4d8a-8cf7-b893d1489290 tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] [instance: 2ce56b72-9fe8-41ca-bd6e-31591ef3b494] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129815) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 21:39:42.379062 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:43.271251 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:43.521894 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:48.027934 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:39:48.048351 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:39:48.048765 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:39:48.177293 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:48.180731 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:39:48.181136 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:39:48.181861 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:39:48.182255 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:39:48.199095 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Getting quotas for project b533f85aeddf4d8db05f2c53a61befc3. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:39:48.203142 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Getting quotas for user 62209b9802ab46c3b3d094d4d1ad86fe and project b533f85aeddf4d8db05f2c53a61befc3. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:39:48.215109 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] [instance: 997f89c5-8086-4a7e-8292-1c8e6a12aaf6] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:39:48.216029 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:39:48.216430 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:39:48.318888 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] [instance: 997f89c5-8086-4a7e-8292-1c8e6a12aaf6] block_device_mapping [BlockDeviceMapping(attachment_id=ec1f7961-d7a3-4aeb-9e33-9c7a71d2b333,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb83e900-2518-45c5-9a34-d536cf6c7a3f',volume_size=1,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:39:48.320217 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:39:48.320617 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:39:48.566124 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:39:48.567348 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5deb236a-d39c-46d5-9195-c61e16f4d607 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:39:58.189241 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:58.324226 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=15 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:58.480894 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:58.481884 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:05.094784 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:10.525160 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:40:10.548397 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:10.548769 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:10.728439 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:10.728755 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:10.729504 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:10.729893 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:10.745270 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Getting quotas for project b533f85aeddf4d8db05f2c53a61befc3. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:40:10.750388 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Getting quotas for user 62209b9802ab46c3b3d094d4d1ad86fe and project b533f85aeddf4d8db05f2c53a61befc3. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:40:10.761196 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] [instance: 1ff78357-ba91-45ba-937e-cf12461b0610] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:40:10.762139 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:10.762535 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:10.832681 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] [instance: 1ff78357-ba91-45ba-937e-cf12461b0610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2dc18b93-7077-47bd-a336-808d90e32062',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:40:10.833921 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:10.834322 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:11.040511 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:11.040925 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-36c8884e-5ba4-40e4-b094-46e28b587ff4 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:19.270363 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:40:20.736312 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:20.844760 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=23 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:20.994103 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:20.994913 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:25.144584 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:35.095201 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=11,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:52.833586 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:40:52.855549 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:52.855961 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.005435 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.006000 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.008138 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.011622 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.039745 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Getting quotas for project 77c9b7e351e24dc88207e9498f75f578. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:40:53.046680 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Getting quotas for user 833136cbdeab4b9e8b6dd2d24c7c8753 and project 77c9b7e351e24dc88207e9498f75f578. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:40:53.076571 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 35a74168-3c95-4bfe-b82a-e93b10ec5820] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:40:53.077334 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.077745 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.168605 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 35a74168-3c95-4bfe-b82a-e93b10ec5820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:40:53.170175 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.171001 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.182569 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:40:53.207319 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.207947 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.514201 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.514606 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-5cc460d9-425d-44ee-aff4-3daa1759ce32 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.530908 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.531372 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.532142 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.532565 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.550630 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Getting quotas for project bd61da83cb56412a8757633c22561495. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:40:53.555598 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Getting quotas for user f7948b58ee714cb1bfd4d8364dae19ee and project bd61da83cb56412a8757633c22561495. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:40:53.568532 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] [instance: cc9ed855-3638-40c6-92ae-7a4029ffae5d] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:40:53.569755 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.570163 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:53.655784 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] [instance: cc9ed855-3638-40c6-92ae-7a4029ffae5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:40:53.657818 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:53.658245 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:54.075026 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:54.075488 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-39dada0a-cc58-404a-af47-08ff8806e017 tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:58.309352 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:40:58.321356 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:58.321767 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:58.447687 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:58.449966 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:58.450376 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:58.451151 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:58.451549 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:58.468237 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Getting quotas for project 56b8099d9406431284b4dd58b5c16359. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:40:58.473441 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Getting quotas for user 95cd6b54d8164de1a524b407a1852ebd and project 56b8099d9406431284b4dd58b5c16359. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:40:58.484761 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] [instance: 97d5b8fb-ce56-41ba-b786-5f8474c9b2f3] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:40:58.486196 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:58.486624 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:58.559820 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:40:58.592473 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] [instance: 97d5b8fb-ce56-41ba-b786-5f8474c9b2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:40:58.597355 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:58.597355 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:40:58.913984 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:40:58.914435 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c256f437-0ad0-4a3d-891b-0a898d8b3740 tempest-VolumesSnapshotTestJSON-1954720325 tempest-VolumesSnapshotTestJSON-1954720325-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:03.541408 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:03.663492 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:03.757714 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:03.943860 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:08.459955 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:08.597989 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=34 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:08.829674 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:08.832010 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:14.223513 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:41:14.243794 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:14.244209 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:14.424028 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:14.426839 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:14.427286 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:14.428015 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:14.428421 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:14.444622 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Getting quotas for project bd61da83cb56412a8757633c22561495. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:41:14.449282 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Getting quotas for user f7948b58ee714cb1bfd4d8364dae19ee and project bd61da83cb56412a8757633c22561495. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:41:14.460167 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] [instance: 9df14d8c-4fff-439d-af43-10a008a7b9d2] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:41:14.462722 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:14.462722 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:14.524274 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] [instance: 9df14d8c-4fff-439d-af43-10a008a7b9d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:41:14.525546 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:14.525962 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:14.811642 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:14.812044 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4cba47c8-0941-4e04-adc8-638c6daa8e8c tempest-VolumesActionsTest-484965280 tempest-VolumesActionsTest-484965280-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:18.947708 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:41:24.434559 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:24.530081 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:24.720800 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:24.721516 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:35.164808 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=11,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:39.328166 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c4fbcc5a-0d53-4509-810c-64ea09936ebb tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:41:39.328166 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c4fbcc5a-0d53-4509-810c-64ea09936ebb tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:39.328166 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c4fbcc5a-0d53-4509-810c-64ea09936ebb tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:39.677732 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-c4fbcc5a-0d53-4509-810c-64ea09936ebb tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] [instance: 35a74168-3c95-4bfe-b82a-e93b10ec5820] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 21:41:40.384236 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-c4fbcc5a-0d53-4509-810c-64ea09936ebb tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Created allocations for migration fe15e4cd-d068-446f-b7d0-7fbc452c8ce0 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:41:40.917272 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-c4fbcc5a-0d53-4509-810c-64ea09936ebb tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] [instance: 35a74168-3c95-4bfe-b82a-e93b10ec5820] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 21:41:45.108830 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:47.947976 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:41:47.969280 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:47.969688 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:48.145272 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:48.146580 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:48.147837 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:48.148597 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:48.167657 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Getting quotas for project b533f85aeddf4d8db05f2c53a61befc3. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:41:48.173023 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Getting quotas for user 62209b9802ab46c3b3d094d4d1ad86fe and project b533f85aeddf4d8db05f2c53a61befc3. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:41:48.197962 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] [instance: 5865f75f-6142-4885-9fa6-0687a2c169cc] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:41:48.199373 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:48.199964 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:48.261905 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] [instance: 5865f75f-6142-4885-9fa6-0687a2c169cc] block_device_mapping [BlockDeviceMapping(attachment_id=fdcf6e86-050c-4fa5-b48c-f0b3542f0b3b,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='183425a4-3857-401b-8f23-e0e83f107150',volume_size=1,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:41:48.263895 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:48.264493 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:48.497351 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:41:48.497791 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-891df0cf-812f-4f81-80d6-383250e37051 tempest-TestVolumeBootPattern-1625426921 tempest-TestVolumeBootPattern-1625426921-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:41:50.939435 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:50.941084 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:51.103548 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:58.160242 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:58.268080 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=15 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:58.310463 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:58.359092 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:15.156186 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:20.159632 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:42:20.182129 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:42:20.182548 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:42:20.402855 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:42:20.403684 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:42:20.404587 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:42:20.405104 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:42:20.423911 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Getting quotas for project 251f01f982aa43ad853d53fa06f99190. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:42:20.429204 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Getting quotas for user 82819d3efcda4fe78e2b50bb7fab0a96 and project 251f01f982aa43ad853d53fa06f99190. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:42:20.444692 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] [instance: 0ec2632e-3da8-44ac-b9ba-7300f5bc1f99] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:42:20.446578 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:42:20.447466 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:42:20.569656 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] [instance: 0ec2632e-3da8-44ac-b9ba-7300f5bc1f99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:42:20.570925 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:42:20.571379 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:42:20.908022 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:42:20.908502 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f1e03984-8a55-4866-ad04-eac429ff661e tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:42:25.108624 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:30.411670 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:30.576438 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:30.672608 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:30.806448 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:55.159540 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:05.115242 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:06.425484 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:43:06.457224 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:06.457787 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:06.644814 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:06.645365 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:06.646180 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:06.646794 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:06.665166 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Getting quotas for project 77c9b7e351e24dc88207e9498f75f578. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:43:06.670447 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Getting quotas for user 833136cbdeab4b9e8b6dd2d24c7c8753 and project 77c9b7e351e24dc88207e9498f75f578. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:43:06.685260 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 64b5a7a2-7d82-4c60-802e-8e92c14e0790] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:43:06.685260 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:06.685260 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:06.780737 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 64b5a7a2-7d82-4c60-802e-8e92c14e0790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:43:06.782381 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:06.783160 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:07.166244 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:07.166244 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-b9fc7271-38b7-4056-9c69-40a1997b3891 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:16.656486 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:16.786793 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:16.884149 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:17.019265 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:21.777705 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:43:21.818856 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:21.819854 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:22.000838 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:22.001251 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:22.002380 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:22.002782 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:22.022608 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Getting quotas for project 251f01f982aa43ad853d53fa06f99190. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:43:22.028441 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Getting quotas for user 82819d3efcda4fe78e2b50bb7fab0a96 and project 251f01f982aa43ad853d53fa06f99190. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:43:22.043647 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] [instance: a553b3eb-ae00-4d00-97d1-1d26fe2bdfff] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:43:22.045000 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:22.045624 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:22.107317 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] [instance: a553b3eb-ae00-4d00-97d1-1d26fe2bdfff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:43:22.109238 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:22.109653 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:22.489855 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:22.489855 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-87a95e61-4d20-4c18-b91a-9e60b8e44d67 tempest-TestSecurityGroupsBasicOps-1431728571 tempest-TestSecurityGroupsBasicOps-1431728571-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:32.012220 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:32.113274 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:32.367532 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:32.369139 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:35.180306 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:39.278460 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:43:45.115922 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:55.543596 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-75c961ef-cf67-41af-8bc6-b4814806aefa tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129815) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:43:55.544419 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75c961ef-cf67-41af-8bc6-b4814806aefa tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:43:55.544571 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-75c961ef-cf67-41af-8bc6-b4814806aefa tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:43:56.285923 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.migrate [None req-75c961ef-cf67-41af-8bc6-b4814806aefa tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Created allocations for migration eca2756f-d2f4-4472-b782-341fb0b29cf4 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129815) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:43:56.378938 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.live_migrate [None req-75c961ef-cf67-41af-8bc6-b4814806aefa tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] [instance: 64b5a7a2-7d82-4c60-802e-8e92c14e0790] Requesting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while live migrating {{(pid=129815) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:491}} Jul 16 21:43:57.023241 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-75c961ef-cf67-41af-8bc6-b4814806aefa tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Lazy-loading 'resources' on Instance uuid 64b5a7a2-7d82-4c60-802e-8e92c14e0790 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:43:57.027669 ncdv-master-1 nova-conductor[129815]: DEBUG nova.objects.instance [None req-75c961ef-cf67-41af-8bc6-b4814806aefa tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] Lazy-loading 'pci_requests' on Instance uuid 64b5a7a2-7d82-4c60-802e-8e92c14e0790 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 21:43:57.727245 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.tasks.live_migrate [None req-75c961ef-cf67-41af-8bc6-b4814806aefa tempest-TestNetworkAdvancedServerOps-756251536 tempest-TestNetworkAdvancedServerOps-756251536-project-admin] [instance: 64b5a7a2-7d82-4c60-802e-8e92c14e0790] Start binding ports on destination host: nch2-master-1 {{(pid=129815) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:385}} Jul 16 21:44:06.378489 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:08.223999 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:08.417767 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:15.180322 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:18.569875 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:44:25.107077 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:27.838339 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:44:27.870137 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:27.870822 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:28.106095 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:28.106496 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:28.107260 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:28.107654 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:28.125844 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Getting quotas for project 17459e07487944958c9c307e59e1c8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:44:28.130934 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Getting quotas for user beae3bc561e141fc9229b40466840078 and project 17459e07487944958c9c307e59e1c8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:44:28.143437 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] [instance: 183fd84f-828f-49a3-9ec9-9831dbfcc555] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:44:28.144383 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:28.144809 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:28.311219 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] [instance: 183fd84f-828f-49a3-9ec9-9831dbfcc555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:44:28.311219 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:28.311219 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:28.904291 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:28.905586 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-84f8a87e-cb05-4efe-be6b-cf88d78ffb67 tempest-InstanceActionsTestJSON-1060560037 tempest-InstanceActionsTestJSON-1060560037-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:38.116599 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:38.279804 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:38.794419 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:38.795972 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:38.957656 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:44:39.511260 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:44:39.544384 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:39.544798 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:39.663548 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:39.664662 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:39.664662 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:39.665075 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:39.682368 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Getting quotas for project 77c9b7e351e24dc88207e9498f75f578. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:44:39.690248 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Getting quotas for user 833136cbdeab4b9e8b6dd2d24c7c8753 and project 77c9b7e351e24dc88207e9498f75f578. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:44:39.712944 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 0b62eebf-c7ed-4fa1-a4d1-17947e5d8226] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:44:39.713988 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:39.714493 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:39.815026 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 0b62eebf-c7ed-4fa1-a4d1-17947e5d8226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:44:39.816367 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:39.816783 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:40.130986 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:40.131649 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-69fb5d44-66b9-4071-8644-c347699f6767 tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:49.671444 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:49.821139 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:50.061453 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:50.062371 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:55.195890 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:58.034363 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:44:58.057900 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:58.058669 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:58.166732 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:58.166732 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:58.166732 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:58.166732 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:58.187586 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Getting quotas for project e60c0863dc6f4313bdc873fda27ae2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:44:58.195536 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Getting quotas for user 0ab8b3f06e994bbca5d6dd14109bfe50 and project e60c0863dc6f4313bdc873fda27ae2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:44:58.209928 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] [instance: 770fd99a-ef16-4922-847d-bcadc19b90f6] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:44:58.211170 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:58.211587 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:58.314625 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] [instance: 770fd99a-ef16-4922-847d-bcadc19b90f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:44:58.316129 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:58.316636 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:44:58.667644 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:44:58.668414 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b2c207-9069-42ad-9ef0-6cc8c116930a tempest-AttachVolumeNegativeTest-17004004 tempest-AttachVolumeNegativeTest-17004004-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:03.444439 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:45:03.478079 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:03.478800 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:03.833059 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:03.843776 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:03.844468 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:03.845280 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:03.845606 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:03.884747 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Getting quotas for project b351f1a2d6434cd0b3b03628a0befe14. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:45:03.897474 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Getting quotas for user e32ea3fe570b40b59110b70fbb0c3caf and project b351f1a2d6434cd0b3b03628a0befe14. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:45:03.919717 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] [instance: 0793bca6-2775-4777-a4e3-1fa6a2e45eac] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:45:03.920278 ncdv-master-1 nova-conductor[129815]: DEBUG nova.scheduler.utils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Re-scheduling is disabled due to forcing a host (['nch2-master-1']) and/or node ([]) {{(pid=129815) populate_retry /opt/stack/nova/nova/scheduler/utils.py:976}} Jul 16 21:45:03.921133 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:03.921554 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:04.003352 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] [instance: 0793bca6-2775-4777-a4e3-1fa6a2e45eac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:45:04.004557 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:04.004982 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:04.360481 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:04.361256 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e37bac5f-9fc0-4fcf-8b2e-e587ce7455f4 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:08.177847 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:08.321394 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:08.437287 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=10 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:08.532193 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:13.867859 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:14.010506 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:14.151515 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:14.258834 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:15.183077 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:20.528251 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:45:20.550684 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:20.551214 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:20.930187 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:20.930596 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:20.931377 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:20.931772 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:20.948749 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:45:20.953593 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for user cfe293b9ed3645229bed5ef8ce17cfec and project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:45:20.968320 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: 3618ceb8-9d10-4219-8885-d2d5004c71ad] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:45:20.969451 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:20.970146 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:21.077066 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: 3618ceb8-9d10-4219-8885-d2d5004c71ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:45:21.078348 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:21.085008 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:21.309975 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:45:21.330913 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:21.331384 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:21.437189 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:21.437573 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-05ea5df9-2e4a-453a-bb0b-9c24ce6c7831 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:21.475828 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:21.476237 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:21.476966 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:21.477366 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:21.493101 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Getting quotas for project b351f1a2d6434cd0b3b03628a0befe14. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:45:21.497834 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Getting quotas for user e32ea3fe570b40b59110b70fbb0c3caf and project b351f1a2d6434cd0b3b03628a0befe14. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:45:21.509476 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] [instance: f0c3fd0a-44d4-4209-9c2f-817382c0afa7] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:45:21.510015 ncdv-master-1 nova-conductor[129815]: DEBUG nova.scheduler.utils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Re-scheduling is disabled due to forcing a host (['nch1-master-1']) and/or node ([]) {{(pid=129815) populate_retry /opt/stack/nova/nova/scheduler/utils.py:976}} Jul 16 21:45:21.510786 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:21.511225 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:21.584625 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] [instance: f0c3fd0a-44d4-4209-9c2f-817382c0afa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:45:21.585893 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:21.586332 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:21.873457 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:21.873892 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-680398e9-baa9-4abb-a788-be0d834187c9 tempest-TestServerMultinode-1172294623 tempest-TestServerMultinode-1172294623-project-admin] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:25.076717 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-34ef0e71-dc55-4dcd-9550-540701866d0d tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method rebuild_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:45:25.077341 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-34ef0e71-dc55-4dcd-9550-540701866d0d tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:45:25.077624 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-34ef0e71-dc55-4dcd-9550-540701866d0d tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:45:25.193017 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-34ef0e71-dc55-4dcd-9550-540701866d0d tempest-TestNetworkAdvancedServerOps-375332741 tempest-TestNetworkAdvancedServerOps-375332741-project] [instance: 0b62eebf-c7ed-4fa1-a4d1-17947e5d8226] No migration record for the rebuild/evacuate request. {{(pid=129816) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Jul 16 21:45:30.940789 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:31.484487 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:31.589913 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:31.718686 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:31.798320 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:35.068173 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:35.113253 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=18,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:35.236248 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:35.265941 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=16,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=19,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:55.184714 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:00.997486 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:46:01.018285 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:46:01.018699 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:46:01.223280 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:46:01.223651 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:46:01.225137 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:46:01.225623 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:46:01.244099 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Getting quotas for project 8f296b14a61a4997bf411c9b0fdc39d5. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:46:01.249115 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Getting quotas for user 001ed11a062a4cb08a52d1294ef5880b and project 8f296b14a61a4997bf411c9b0fdc39d5. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:46:01.261030 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] [instance: a83a3f66-378b-40a4-baf0-0d67c58f1524] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:46:01.261993 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:46:01.262467 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:46:01.447430 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] [instance: a83a3f66-378b-40a4-baf0-0d67c58f1524] block_device_mapping [BlockDeviceMapping(attachment_id=94ddb0bb-4ce9-4972-a08c-ca3c9a1d3244,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='34b057b6-39af-4a53-9a45-d9404aea035f',volume_size=1,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:46:01.449219 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:46:01.449941 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:46:01.725125 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:46:01.725498 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-501d9f67-9f22-4c36-8150-38f04d69d8b8 tempest-TestVolumeBackupRestore-577066854 tempest-TestVolumeBackupRestore-577066854-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:46:11.236420 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:11.454581 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=16,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:11.550395 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:11.628989 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:15.110930 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:35.184934 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:45.113950 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:59.287351 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:47:15.186632 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:22.340302 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:47:22.360366 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:47:22.360775 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:47:22.475904 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:47:22.476231 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:47:22.476966 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:47:22.477621 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:47:22.493327 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:47:22.497955 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for user cfe293b9ed3645229bed5ef8ce17cfec and project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:47:22.517097 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: eb9f9cfd-8fe0-4803-8f57-e477e1efb7ad] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:47:22.518727 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:47:22.519266 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:47:22.607784 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: eb9f9cfd-8fe0-4803-8f57-e477e1efb7ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:47:22.609149 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:47:22.609552 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:47:22.847050 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:47:22.847792 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-851dce0b-173b-4f15-ac10-9233d4840c98 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:47:25.131356 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:32.484963 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:32.613622 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:32.737835 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:32.781762 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:45.123258 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:55.187758 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=13,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:58.967424 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:48:04.970384 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:48:04.991947 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:48:04.997022 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:48:05.149003 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:48:05.149328 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:48:05.150051 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:48:05.150468 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:48:05.167192 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:48:05.171865 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for user cfe293b9ed3645229bed5ef8ce17cfec and project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:48:05.183855 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: bbfa7c88-b995-4c25-b981-1ada326424ed] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:48:05.184791 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:48:05.185193 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:48:05.281876 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: bbfa7c88-b995-4c25-b981-1ada326424ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:48:05.287867 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:48:05.287867 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:48:05.538395 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:48:05.538958 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-c8cd9c77-2598-488c-b8b1-cd45f11255f9 tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:48:15.156784 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:15.291508 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:15.374131 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:15.451771 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:25.128450 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:35.190221 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:45.134074 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:05.133884 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:15.193952 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:35.139977 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:55.188224 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:58.589507 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Took 2.40 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:49:58.611557 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:49:58.611964 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:49:58.784749 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:49:58.785191 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:49:58.785915 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:49:58.786309 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:49:58.802767 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:49:58.807598 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for user cfe293b9ed3645229bed5ef8ce17cfec and project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:49:58.819938 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: 5d7c5a9b-cfb1-49ce-be31-b19603177834] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:49:58.820867 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:49:58.821264 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:49:58.916422 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: 5d7c5a9b-cfb1-49ce-be31-b19603177834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:49:58.917684 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:49:58.918102 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:49:59.207238 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:49:59.207700 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:49:59.217070 ncdv-master-1 nova-conductor[129816]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [14e89f4f-82d5-4caa-b986-63be39038edb] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 16 21:50:00.226094 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [None req-4cd9455b-1a5f-49e7-9a4f-43d68f2c173c tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [14e89f4f-82d5-4caa-b986-63be39038edb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51716. Jul 16 21:50:08.792156 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:08.921610 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:09.121633 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:09.122426 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:15.143212 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:16.855433 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:50:16.889041 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:50:16.890154 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:50:17.030334 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:50:17.030959 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:50:17.031924 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:50:17.032841 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:50:17.056597 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:50:17.062191 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Getting quotas for user cfe293b9ed3645229bed5ef8ce17cfec and project 1e7cd69b8ddd4aceb45a4aaacdfccea7. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:50:17.075906 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: a2bd21dc-856d-41b0-8d5c-139452473742] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:50:17.078952 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:50:17.078952 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:50:17.167832 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] [instance: a2bd21dc-856d-41b0-8d5c-139452473742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:50:17.169242 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:50:17.170576 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:50:17.471670 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:50:17.472558 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-fb7f73b3-8da1-4b60-a9c0-24c38d2e3dcc tempest-ServerActionsTestJSON-1394927270 tempest-ServerActionsTestJSON-1394927270-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:50:19.296659 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:50:27.044276 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:27.173043 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:27.282109 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:27.374992 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:35.192468 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:55.140347 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:58.586073 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:51:15.189654 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:18.977975 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:51:35.137878 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:45.196594 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:47.212141 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:51:47.236356 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:51:47.236356 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:51:47.429715 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:51:47.430124 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:51:47.430851 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:51:47.431366 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:51:47.447865 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Getting quotas for project ecb79581f83f46f6a02fba932e20f3fe. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:51:47.452503 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Getting quotas for user 8d3cada15a55453faaf23a147c44afcf and project ecb79581f83f46f6a02fba932e20f3fe. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:51:47.464858 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] [instance: c1c65e9e-289c-4707-b6f7-45fe851f4fae] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:51:47.470508 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:51:47.470508 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:51:47.547524 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] [instance: c1c65e9e-289c-4707-b6f7-45fe851f4fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:51:47.549176 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:51:47.549581 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:51:47.848245 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:51:47.848577 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-deb1312a-4793-48c5-a062-42435b2089ce tempest-ServerMetadataNegativeTestJSON-1202925361 tempest-ServerMetadataNegativeTestJSON-1202925361-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:51:57.436836 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:57.556145 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:57.659557 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:57.735720 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:05.203310 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=10,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:15.135072 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:45.203509 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:55.131371 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:05.205114 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:12.767261 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:53:15.579465 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:53:25.208579 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:35.130580 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:39.305509 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:54:05.207433 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:54:15.134078 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:54:18.595287 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:54:29.476093 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:54:35.142951 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:54:38.990471 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:54:45.196591 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:15.134034 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:25.196194 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:32.167741 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:55:32.188621 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:55:32.189063 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:55:32.331232 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:55:32.331641 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:55:32.332466 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:55:32.332823 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:55:32.349636 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Getting quotas for project 13ce121469a145a4b00edd3a082413a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:55:32.354187 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Getting quotas for user 2331af9efc5e4af7a901621b7590e80a and project 13ce121469a145a4b00edd3a082413a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:55:32.365626 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] [instance: 2ba83fff-f116-4f5e-8711-550d4a6e2989] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:55:32.366517 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:55:32.366921 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:55:32.406864 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] [instance: 2ba83fff-f116-4f5e-8711-550d4a6e2989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:55:32.408083 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:55:32.408495 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:55:32.665634 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:55:32.666006 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-259a97bf-5622-4dec-9b25-9103942b207d tempest-VolumesActionsTest-763750246 tempest-VolumesActionsTest-763750246-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:55:42.340491 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:42.411638 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:42.491395 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:42.581231 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:55.133611 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:05.191709 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:15.136616 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:45.177788 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:55.125162 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:59.314278 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:57:01.683644 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:57:05.178413 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:35.130789 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:37.325413 ncdv-master-1 nova-conductor[129816]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] [2f0fb173-418a-4bd4-b98a-77b1c7b4f960] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 16 21:57:38.333183 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] [2f0fb173-418a-4bd4-b98a-77b1c7b4f960] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57174. Jul 16 21:57:38.604414 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:57:38.994038 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Took 1.67 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:57:39.015856 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:57:39.016266 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:57:39.212077 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:39.215646 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:57:39.216053 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:57:39.216778 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:57:39.217169 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:57:39.233397 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Getting quotas for project 46b1acf286d840738d93acc4ee506029. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:57:39.239226 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Getting quotas for user 92d1d7ddc009428bb340e9c6f20aa7f3 and project 46b1acf286d840738d93acc4ee506029. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:57:39.251098 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] [instance: e317fe1f-3367-4d70-a4c7-e357b93e3a49] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:57:39.252020 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:57:39.252432 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:57:39.306785 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] [instance: e317fe1f-3367-4d70-a4c7-e357b93e3a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:57:39.308094 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:57:39.308510 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:57:39.480213 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:57:39.480834 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd95696-4fdc-4d46-baeb-6ad13e22574c tempest-ServersAdminNegativeTestJSON-211662210 tempest-ServersAdminNegativeTestJSON-211662210-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:57:49.225703 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:49.311868 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:49.367799 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:49.430012 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:59.001718 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 21:58:04.427119 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:58:04.447529 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:58:04.447941 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:58:04.586442 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:58:04.586771 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:58:04.587561 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:58:04.587962 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:58:04.607287 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Getting quotas for project 8849a8b6fc0648ed817530d7b57fe09a. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:58:04.612229 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Getting quotas for user 303ba697a1f94661b93254ac0f198670 and project 8849a8b6fc0648ed817530d7b57fe09a. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:58:04.624198 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] [instance: f6044bec-67bc-46bd-9681-db14474b2a5b] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:58:04.625145 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:58:04.625558 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:58:04.678714 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] [instance: f6044bec-67bc-46bd-9681-db14474b2a5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:58:04.680133 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:58:04.680600 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:58:04.950645 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:58:04.951547 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-055153b7-f540-4a40-b5de-b075704feb9f tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:58:05.193255 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:14.595407 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:14.684577 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:14.807608 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:14.808193 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:15.144903 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:15.867521 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f10ca1e9-4de8-4b37-b716-415ad7d97bd6 tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:58:15.868062 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f10ca1e9-4de8-4b37-b716-415ad7d97bd6 tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:58:15.869586 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f10ca1e9-4de8-4b37-b716-415ad7d97bd6 tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:58:16.189722 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-f10ca1e9-4de8-4b37-b716-415ad7d97bd6 tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] [instance: f6044bec-67bc-46bd-9681-db14474b2a5b] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 21:58:16.685285 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-f10ca1e9-4de8-4b37-b716-415ad7d97bd6 tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] Created allocations for migration 6f4149a5-b438-4609-923a-4360441fbb4d on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:58:17.132298 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-f10ca1e9-4de8-4b37-b716-415ad7d97bd6 tempest-DeleteServersTestJSON-1493471914 tempest-DeleteServersTestJSON-1493471914-project] [instance: f6044bec-67bc-46bd-9681-db14474b2a5b] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"fcc75857-7dde-4ac0-88e4-871d39001997": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fcc75857-7dde-4ac0-88e4-871d39001997"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=fcc75857-7dde-4ac0-88e4-871d39001997,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 21:58:27.155354 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:27.156164 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:27.315347 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:45.147298 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:45.198632 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:05.198992 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:09.420954 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 21:59:09.442246 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:59:09.442638 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:59:09.562605 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:59:09.562978 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:59:09.563803 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:59:09.564205 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:59:09.579673 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Getting quotas for project 9934bd813edb4e55a2d7c61207a9c46d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 21:59:09.584410 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Getting quotas for user d980641608134eadb72afa6fddb6adeb and project 9934bd813edb4e55a2d7c61207a9c46d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 21:59:09.596257 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] [instance: 853637be-2161-4b9e-903a-2cbce6ff6881] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 21:59:09.597188 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:59:09.597595 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:59:09.660172 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] [instance: 853637be-2161-4b9e-903a-2cbce6ff6881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 21:59:09.661443 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:59:09.661852 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:59:09.969959 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:59:09.970382 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-85908462-8228-4531-8e8d-951b3791281b tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:59:19.571280 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:19.665202 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:19.766742 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:19.852694 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:22.082031 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-31707496-164f-4a99-b088-80c76b7e10e7 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 21:59:22.082541 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-31707496-164f-4a99-b088-80c76b7e10e7 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 21:59:22.083158 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-31707496-164f-4a99-b088-80c76b7e10e7 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 21:59:22.293377 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-31707496-164f-4a99-b088-80c76b7e10e7 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] [instance: 853637be-2161-4b9e-903a-2cbce6ff6881] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 21:59:22.769990 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-31707496-164f-4a99-b088-80c76b7e10e7 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Created allocations for migration 292aade7-ec9d-4867-b488-8765ea281458 on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 21:59:23.186318 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-31707496-164f-4a99-b088-80c76b7e10e7 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] [instance: 853637be-2161-4b9e-903a-2cbce6ff6881] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [Selection(allocation_request='{"allocations": {"c18c7b31-cb52-43e0-ba1f-41c40f4e73e5": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c18c7b31-cb52-43e0-ba1f-41c40f4e73e5"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=c18c7b31-cb52-43e0-ba1f-41c40f4e73e5,limits=SchedulerLimits,nodename='nch2-master-1',service_host='nch2-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 21:59:25.154976 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:33.208403 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:33.210324 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:33.353030 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:45.202484 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:04.282137 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:00:04.302930 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:00:04.303368 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:00:04.420637 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:04.422894 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:00:04.423331 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:00:04.424064 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:00:04.424462 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:00:04.440242 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Getting quotas for project 9934bd813edb4e55a2d7c61207a9c46d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:00:04.445622 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Getting quotas for user d980641608134eadb72afa6fddb6adeb and project 9934bd813edb4e55a2d7c61207a9c46d. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:00:04.457060 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] [instance: 96ec3b45-063c-4bc9-84e5-e59532a23783] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:00:04.458117 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:00:04.458462 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:00:04.520613 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] [instance: 96ec3b45-063c-4bc9-84e5-e59532a23783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:00:04.521849 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:00:04.522260 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:00:04.740559 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:00:04.740998 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-451db02e-0231-4a07-aa70-ae36b0532cb5 tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:00:14.431640 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:14.525604 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:14.593279 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:14.667126 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:17.561150 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-1acfc018-f861-48b7-947c-c6fe2c49980d tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 22:00:17.561661 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1acfc018-f861-48b7-947c-c6fe2c49980d tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:00:17.562169 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-1acfc018-f861-48b7-947c-c6fe2c49980d tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:00:17.758827 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-1acfc018-f861-48b7-947c-c6fe2c49980d tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] [instance: 96ec3b45-063c-4bc9-84e5-e59532a23783] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 22:00:18.220799 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-1acfc018-f861-48b7-947c-c6fe2c49980d tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] Created allocations for migration c24fcd32-9fc9-486e-aff8-377328db6815 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 22:00:18.623436 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-1acfc018-f861-48b7-947c-c6fe2c49980d tempest-ServerDiskConfigTestJSON-184551575 tempest-ServerDiskConfigTestJSON-184551575-project] [instance: 96ec3b45-063c-4bc9-84e5-e59532a23783] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"fcc75857-7dde-4ac0-88e4-871d39001997": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fcc75857-7dde-4ac0-88e4-871d39001997"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=fcc75857-7dde-4ac0-88e4-871d39001997,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 22:00:19.322632 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:00:25.209249 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:28.648500 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:28.650247 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:28.868385 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:35.157663 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:58.611887 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:01:05.211865 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:15.163814 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:19.011417 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:01:20.880026 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:01:20.901972 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:01:20.902386 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:01:21.074575 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:01:21.074982 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:01:21.075740 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:01:21.076141 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:01:21.091648 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Getting quotas for project fd21231d9af34d9aa4f9e03229b49a30. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:01:21.096227 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Getting quotas for user 718f6de3b1a1453d9579d421a574691e and project fd21231d9af34d9aa4f9e03229b49a30. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:01:21.107109 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: ccef2dfa-df64-4f44-96db-85598e217ba8] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:01:21.107999 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:01:21.108431 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:01:21.154586 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: ccef2dfa-df64-4f44-96db-85598e217ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:01:21.155856 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:01:21.156273 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:01:21.304511 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:01:21.304929 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3d885b28-f388-4c97-81ce-1bf7b734d705 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:01:31.083223 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:31.159415 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:31.220823 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:31.265984 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:45.164417 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=11,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:45.205464 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:11.621168 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-df56db40-9b51-42f2-88a3-b80b26d61dab tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 22:02:11.621782 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-df56db40-9b51-42f2-88a3-b80b26d61dab tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:02:11.622056 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-df56db40-9b51-42f2-88a3-b80b26d61dab tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:02:11.807436 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-df56db40-9b51-42f2-88a3-b80b26d61dab tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: ccef2dfa-df64-4f44-96db-85598e217ba8] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 22:02:12.245531 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-df56db40-9b51-42f2-88a3-b80b26d61dab tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Created allocations for migration 9f51f802-14c5-49c6-886e-ab3e41c4644f on c18c7b31-cb52-43e0-ba1f-41c40f4e73e5 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 22:02:12.701822 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-df56db40-9b51-42f2-88a3-b80b26d61dab tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: ccef2dfa-df64-4f44-96db-85598e217ba8] Calling prep_resize with selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [Selection(allocation_request='{"allocations": {"c18c7b31-cb52-43e0-ba1f-41c40f4e73e5": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c18c7b31-cb52-43e0-ba1f-41c40f4e73e5"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=c18c7b31-cb52-43e0-ba1f-41c40f4e73e5,limits=SchedulerLimits,nodename='nch2-master-1',service_host='nch2-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 22:02:15.173829 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:22.725350 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:22.727215 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:22.927317 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:25.211552 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:45.186058 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:45.217065 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:45.827311 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:02:45.850087 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:02:45.850500 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:02:45.992413 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:02:45.992820 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:02:45.993551 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:02:45.993948 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:02:46.010273 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Getting quotas for project fd21231d9af34d9aa4f9e03229b49a30. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:02:46.014939 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Getting quotas for user 718f6de3b1a1453d9579d421a574691e and project fd21231d9af34d9aa4f9e03229b49a30. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:02:46.026055 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: 3447d99f-2076-4204-b4d2-55339d60ca3a] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:02:46.026955 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:02:46.027397 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:02:46.113074 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: 3447d99f-2076-4204-b4d2-55339d60ca3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:02:46.114274 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:02:46.114665 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:02:46.354535 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:02:46.355228 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-3ed37ea9-86f3-4f7d-aa0f-af6171e94a35 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:02:56.000057 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:56.118156 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:56.291791 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:56.292504 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:25.189532 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:25.220951 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:39.330837 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:03:43.662080 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f3bb024c-542a-428b-9097-276b7dcf6a0b tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 22:03:43.662705 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f3bb024c-542a-428b-9097-276b7dcf6a0b tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:03:43.662986 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f3bb024c-542a-428b-9097-276b7dcf6a0b tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:03:43.927594 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-f3bb024c-542a-428b-9097-276b7dcf6a0b tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: 3447d99f-2076-4204-b4d2-55339d60ca3a] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 22:03:44.457463 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-f3bb024c-542a-428b-9097-276b7dcf6a0b tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Created allocations for migration d9f5f312-e2dc-4cd1-a500-53cdd80e1b1f on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 22:03:44.975723 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-f3bb024c-542a-428b-9097-276b7dcf6a0b tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: 3447d99f-2076-4204-b4d2-55339d60ca3a] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"fcc75857-7dde-4ac0-88e4-871d39001997": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fcc75857-7dde-4ac0-88e4-871d39001997"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=fcc75857-7dde-4ac0-88e4-871d39001997,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 22:03:54.998204 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:55.000094 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:55.172105 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:55.191064 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:55.221672 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:03.841267 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:04:03.862032 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:04:03.862446 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:04:04.017789 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:04:04.018129 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:04:04.018877 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:04:04.019310 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:04:04.035192 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Getting quotas for project fd21231d9af34d9aa4f9e03229b49a30. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:04:04.040047 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Getting quotas for user 718f6de3b1a1453d9579d421a574691e and project fd21231d9af34d9aa4f9e03229b49a30. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:04:04.051030 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: fa9945a3-51cc-4366-bc7f-31ddb4f0fa01] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:04:04.052511 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:04:04.052919 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:04:04.105972 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: fa9945a3-51cc-4366-bc7f-31ddb4f0fa01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:04:04.107230 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:04:04.107639 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:04:04.384491 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:04:04.384906 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-232d2cbd-bba9-46b1-8ae0-7e24d6dfed73 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:04:14.026429 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:14.111444 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:14.299040 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:14.299807 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:18.623847 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:04:35.198419 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:35.228207 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:39.020272 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:04:50.862166 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-3f71f2a3-71c2-447d-8698-9d43dc730786 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 22:04:50.862684 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3f71f2a3-71c2-447d-8698-9d43dc730786 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:04:50.863119 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-3f71f2a3-71c2-447d-8698-9d43dc730786 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:04:51.075138 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-3f71f2a3-71c2-447d-8698-9d43dc730786 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: fa9945a3-51cc-4366-bc7f-31ddb4f0fa01] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 22:04:51.627357 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-3f71f2a3-71c2-447d-8698-9d43dc730786 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Created allocations for migration f54d4155-22f2-49f6-843b-953f56fa891d on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 22:04:52.108720 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-3f71f2a3-71c2-447d-8698-9d43dc730786 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: fa9945a3-51cc-4366-bc7f-31ddb4f0fa01] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"fcc75857-7dde-4ac0-88e4-871d39001997": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fcc75857-7dde-4ac0-88e4-871d39001997"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=fcc75857-7dde-4ac0-88e4-871d39001997,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 22:04:55.204243 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:55.235515 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:02.131773 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:02.134570 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:02.311055 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:28.617430 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:05:28.630956 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:05:28.631395 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:05:28.717790 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:28.721437 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:05:28.721836 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:05:28.722559 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:05:28.722950 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:05:28.739383 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Getting quotas for project fd21231d9af34d9aa4f9e03229b49a30. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:05:28.744460 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Getting quotas for user 718f6de3b1a1453d9579d421a574691e and project fd21231d9af34d9aa4f9e03229b49a30. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:05:28.756496 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: 7efe6f96-4156-45dc-b337-fb451e51fdd4] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:05:28.757382 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:05:28.757783 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:05:28.812481 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: 7efe6f96-4156-45dc-b337-fb451e51fdd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:05:28.813692 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:05:28.814822 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:05:29.040153 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:05:29.040497 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7d3c6d08-8afb-4cf6-92d6-df8a865721eb tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:05:35.233367 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:38.730542 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:38.818381 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:38.890860 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:38.952514 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:05.205057 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:15.232489 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:21.942972 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 22:06:21.943536 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:06:21.943903 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:06:22.135717 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: 7efe6f96-4156-45dc-b337-fb451e51fdd4] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 22:06:22.619372 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] Created allocations for migration 27b543fc-e79e-4b2b-b979-a38ed59cbcf0 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 22:06:23.009272 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 tempest-ServerActionsTestJSON-164809533 tempest-ServerActionsTestJSON-164809533-project] [instance: 7efe6f96-4156-45dc-b337-fb451e51fdd4] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"fcc75857-7dde-4ac0-88e4-871d39001997": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fcc75857-7dde-4ac0-88e4-871d39001997"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=fcc75857-7dde-4ac0-88e4-871d39001997,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 22:06:33.031909 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:33.033787 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:33.210347 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:35.204522 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:55.233859 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:59.338767 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:07:05.208229 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:19.595615 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:07:19.616034 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:19.616446 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:19.794435 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:19.794843 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:19.795603 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:19.796004 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:19.811608 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Getting quotas for project 1617cbc6e7cf4eed8d2f8968da996b9c. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:07:19.816242 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Getting quotas for user b91f7cf2a74f45858448608b096b0c31 and project 1617cbc6e7cf4eed8d2f8968da996b9c. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:07:19.828353 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] [instance: dc0abe67-6867-4794-aaa6-5235d45edf2a] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:07:19.828758 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:19.829171 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:19.902419 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] [instance: dc0abe67-6867-4794-aaa6-5235d45edf2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:07:19.904007 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:19.905286 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:20.144920 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:20.145263 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-e708d748-f672-4806-a445-e61dd7f048cf tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:29.801817 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:29.908819 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:30.064688 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=8 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:30.065426 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:32.376199 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:07:32.396737 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:32.397144 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:32.522053 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:32.524364 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:32.524771 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:32.525499 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:32.525891 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:32.541673 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Getting quotas for project 1617cbc6e7cf4eed8d2f8968da996b9c. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:07:32.546564 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Getting quotas for user b91f7cf2a74f45858448608b096b0c31 and project 1617cbc6e7cf4eed8d2f8968da996b9c. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:07:32.557305 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] [instance: c918af94-53fe-4a9b-9b3f-b9829038314f] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:07:32.558187 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:32.558592 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:32.627674 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] [instance: c918af94-53fe-4a9b-9b3f-b9829038314f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:07:32.628851 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:32.629504 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:32.914797 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:07:32.915200 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-f9bc1179-05a6-4812-9e71-c2adc106ba05 tempest-ServersNegativeTestJSON-95771019 tempest-ServersNegativeTestJSON-95771019-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:07:38.634781 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:07:42.532228 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:42.633497 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:42.758604 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:42.843946 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:45.210260 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:59.028280 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:08:05.228857 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:15.211846 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:45.263173 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:45.264082 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:48.936499 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:08:48.958264 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:08:48.958670 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:08:49.241990 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:08:49.242314 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:08:49.243060 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:08:49.243458 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:08:49.260923 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Getting quotas for project deb1e913bedd4fb5b286e21c60e27a41. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:08:49.265803 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Getting quotas for user d749cd77cf5c489e8c4e57e02ce768fd and project deb1e913bedd4fb5b286e21c60e27a41. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:08:49.276437 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] [instance: d9281e80-5a8e-4a1e-9e1f-4de3b0dc6131] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:08:49.277331 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:08:49.277734 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:08:49.335436 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] [instance: d9281e80-5a8e-4a1e-9e1f-4de3b0dc6131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d714c43d-c90e-4585-9c04-d0800a9d9919',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:08:49.336626 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:08:49.337025 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:08:49.578601 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:08:49.579034 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-51456fd1-3317-4a6f-8ffe-f310ce85db53 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:08:59.253688 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:59.340580 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=12,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=15,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:59.409201 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=16 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:59.475467 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:09:25.221713 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:09:25.242864 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:09:45.230877 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:10:05.240657 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:10:19.347918 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:10:21.701085 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:10:25.226500 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:10:35.242552 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:10:55.245571 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:10:58.645120 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:11:05.237608 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:11:19.038348 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:11:32.789622 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:11:35.244553 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:11:35.603411 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:11:45.232104 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:12:15.241716 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:12:25.231821 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:12:49.501226 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:12:55.234906 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:12:55.246600 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:11.695845 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:13:11.719044 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:13:11.719472 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:13:11.859472 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:13:11.859886 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:13:11.860636 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:13:11.861026 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:13:11.879737 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Getting quotas for project deb1e913bedd4fb5b286e21c60e27a41. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:13:11.884623 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Getting quotas for user d749cd77cf5c489e8c4e57e02ce768fd and project deb1e913bedd4fb5b286e21c60e27a41. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:13:11.895736 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] [instance: 41010ce2-2848-458a-b6da-5d2ac455bcc0] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:13:11.896658 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:13:11.897071 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:13:11.986872 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] [instance: 41010ce2-2848-458a-b6da-5d2ac455bcc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6ff19cf-4441-40c7-b562-e3d97c668a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:13:11.990134 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:13:11.990134 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:13:12.239418 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:13:12.239833 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-d4327bef-6370-4481-9344-5d586d9f9ac4 tempest-TestMinimumBasicScenario-1144486311 tempest-TestMinimumBasicScenario-1144486311-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:13:21.871741 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:21.992191 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=14 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:22.082762 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:22.160999 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:35.243993 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:35.256038 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:39.356143 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:14:15.238270 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:14:15.259945 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:14:18.653008 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:14:39.045616 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:14:52.800893 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:14:55.230370 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:14:55.261729 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:14:55.611424 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:15:15.237476 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:15.272654 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:19.891514 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:15:19.912568 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:15:19.912802 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:15:20.088551 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:15:20.089103 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:15:20.090143 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:15:20.090899 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:15:20.110833 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:15:20.116393 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for user 4b8c7ad3cc6240c096c2c7cf31d8f74f and project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:15:20.130078 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: 8f799adb-6c06-4b1f-88ea-318088c8ede0] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:15:20.131357 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:15:20.131767 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:15:20.234187 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: 8f799adb-6c06-4b1f-88ea-318088c8ede0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:15:20.236233 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:15:20.236706 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:15:20.523415 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:15:20.523825 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-9d8ec619-2c07-4224-9421-d394f6d9d533 tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:15:21.710791 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:15:30.099744 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:30.246817 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:30.329060 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:30.413001 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:35.232797 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=10,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:45.276876 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:09.510650 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:16:15.227983 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:25.274307 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:30.732376 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:16:30.753875 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:16:30.754407 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:16:30.858311 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:16:30.858889 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:16:30.859663 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:16:30.860068 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:16:30.880601 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:16:30.886364 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for user 4b8c7ad3cc6240c096c2c7cf31d8f74f and project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:16:30.899828 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: 52817115-f50c-4d1b-a4af-b9fddc045246] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:16:30.900802 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:16:30.901198 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:16:30.965857 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: 52817115-f50c-4d1b-a4af-b9fddc045246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:16:30.967161 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:16:30.967576 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:16:31.132408 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:16:31.132855 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7973cd-46d1-4b06-86e2-fe9877d22d8f tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:16:40.870253 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:40.975851 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:41.070194 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:41.070919 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:55.226975 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:59.365330 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:17:05.276982 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:17:35.235595 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:17:38.661787 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:17:45.269201 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:17:59.053800 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:18:12.809492 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:18:15.222642 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:15.621096 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:18:24.154820 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:18:24.175197 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:18:24.175537 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:18:24.355150 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:18:24.355561 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:18:24.356429 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:18:24.357000 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:18:24.374905 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:18:24.386235 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for user 4b8c7ad3cc6240c096c2c7cf31d8f74f and project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:18:24.398521 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: a0d12e80-5ef8-408c-a4d3-92da4c085d85] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:18:24.399572 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:18:24.400034 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:18:24.483537 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: a0d12e80-5ef8-408c-a4d3-92da4c085d85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:18:24.486367 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:18:24.486367 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:18:24.780382 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:18:24.780807 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dbe57d7c-2274-4b4b-8c90-5a1eed7eb5dc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:18:25.268804 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:34.365582 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:34.489625 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:34.623033 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:34.690427 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:55.225715 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=13,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:55.276773 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:07.843324 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-096bb6c6-3202-41a8-96a0-0f7b90a2f0cc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method migrate_server {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 22:19:07.843324 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-096bb6c6-3202-41a8-96a0-0f7b90a2f0cc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:19:07.844127 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-096bb6c6-3202-41a8-96a0-0f7b90a2f0cc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:19:08.132128 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-096bb6c6-3202-41a8-96a0-0f7b90a2f0cc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: a0d12e80-5ef8-408c-a4d3-92da4c085d85] Restricting to cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) while migrating {{(pid=129816) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 16 22:19:08.693509 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-096bb6c6-3202-41a8-96a0-0f7b90a2f0cc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Created allocations for migration 1213c9f9-9a33-4796-a566-36f317cf56a6 on fcc75857-7dde-4ac0-88e4-871d39001997 {{(pid=129816) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Jul 16 22:19:09.266482 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.tasks.migrate [None req-096bb6c6-3202-41a8-96a0-0f7b90a2f0cc tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: a0d12e80-5ef8-408c-a4d3-92da4c085d85] Calling prep_resize with selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [Selection(allocation_request='{"allocations": {"fcc75857-7dde-4ac0-88e4-871d39001997": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fcc75857-7dde-4ac0-88e4-871d39001997"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=327e8df1-39cc-4b36-9ea6-6a9b88ed54fc,compute_node_uuid=fcc75857-7dde-4ac0-88e4-871d39001997,limits=SchedulerLimits,nodename='nch1-master-1',service_host='nch1-master-1')] {{(pid=129816) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Jul 16 22:19:19.288612 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:19.290492 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:19.464762 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:35.224754 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:35.276376 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:15.224677 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:15.274230 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:19.372844 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:20:20.257208 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:20:20.280990 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:20:20.281334 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:20:20.400867 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:20:20.401289 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:20:20.402046 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:20:20.402443 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:20:20.420494 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:20:20.426801 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for user 4b8c7ad3cc6240c096c2c7cf31d8f74f and project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:20:20.442049 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: d7dd236d-4a79-4885-843d-e280807faed7] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:20:20.443250 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:20:20.443894 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:20:20.543949 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: d7dd236d-4a79-4885-843d-e280807faed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:20:20.545231 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:20:20.545649 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:20:20.826104 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:20:20.826878 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-7bbec25c-cdce-4de5-a304-7f3ff507751d tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:20:30.409267 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:30.549480 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:30.657298 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=15 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:30.737626 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:45.229938 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:55.282073 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:58.668986 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:21:05.236534 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:21:19.061577 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:21:25.238560 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:21:25.288586 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:21:55.290837 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:01.721874 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:22:05.245941 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:05.260982 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:22:05.285904 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:22:05.286402 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:22:05.447581 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:22:05.447581 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:22:05.448166 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:22:05.448622 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:22:05.465876 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:22:05.470884 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Getting quotas for user 4b8c7ad3cc6240c096c2c7cf31d8f74f and project a45a8ce6687c427d8f76e4205a076a93. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:22:05.483520 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: 373f324d-27e7-42ba-90b0-6ed693d9cfec] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:22:05.484462 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:22:05.484870 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:22:05.586096 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] [instance: 373f324d-27e7-42ba-90b0-6ed693d9cfec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:22:05.588929 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:22:05.589607 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:22:05.868872 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:22:05.869467 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-6e090fb6-1670-469a-9521-da61fa9417ac tempest-TestNetworkAdvancedServerOps-234580283 tempest-TestNetworkAdvancedServerOps-234580283-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:22:15.454888 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:15.596059 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=17 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:15.780173 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:15.780871 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:25.241481 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:35.288192 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:55.240807 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:15.284421 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:15.631819 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:23:22.748433 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:23:22.778690 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:23:22.779154 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:23:22.953616 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:23:22.954126 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:23:22.954866 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:23:22.955304 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:23:22.970446 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Getting quotas for project f1d60fe3fdc841998824b803809f9e49. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:23:22.975364 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Getting quotas for user 45b6f8ac55464fc99331221b6c67a85d and project f1d60fe3fdc841998824b803809f9e49. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:23:22.987053 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] [instance: 4f08056e-5402-4d5a-88e3-c561d4ef9160] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:23:22.987913 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:23:22.988327 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:23:23.054540 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] [instance: 4f08056e-5402-4d5a-88e3-c561d4ef9160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:23:23.055894 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:23:23.056304 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:23:23.292250 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:23:23.292580 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-4fbfe49f-b3be-4cd5-ad56-7ef0726e39e0 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:23:32.962095 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:33.060187 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:33.227638 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:33.228181 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:35.246849 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:39.383326 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:23:55.291814 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:24:15.239670 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:24:18.677786 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:24:29.522615 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:24:35.285554 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:24:39.069250 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:24:55.234509 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:15.233636 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:15.284252 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:21.731480 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:25:55.232852 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:55.285106 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:57.937252 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c37664c2-a3e7-42a8-a1a1-334e8ac1618b tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Targeting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) for conductor method unshelve_instance {{(pid=129816) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 16 22:25:57.937867 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c37664c2-a3e7-42a8-a1a1-334e8ac1618b tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:25:57.938147 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-c37664c2-a3e7-42a8-a1a1-334e8ac1618b tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:25:58.446369 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c37664c2-a3e7-42a8-a1a1-334e8ac1618b tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] [instance: 4f08056e-5402-4d5a-88e3-c561d4ef9160] Requesting cell 327e8df1-39cc-4b36-9ea6-6a9b88ed54fc(cell1) during scheduling {{(pid=129816) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:929}} Jul 16 22:25:58.936640 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-c37664c2-a3e7-42a8-a1a1-334e8ac1618b tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:25:58.944161 ncdv-master-1 nova-conductor[129816]: DEBUG nova.objects.instance [None req-c37664c2-a3e7-42a8-a1a1-334e8ac1618b tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lazy-loading 'flavor' on Instance uuid 4f08056e-5402-4d5a-88e3-c561d4ef9160 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 22:26:08.939830 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:08.940524 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:08.973788 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:32.824050 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:26:35.232600 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:35.274921 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:35.643290 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:26:55.234578 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:55.275267 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:59.392916 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:27:35.234583 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:35.275945 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:38.685541 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:27:42.584738 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:27:42.609249 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:27:42.609249 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:27:42.686869 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:27:42.687313 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:27:42.688037 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:27:42.688433 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:27:42.706011 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Getting quotas for project f1d60fe3fdc841998824b803809f9e49. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:27:42.710690 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Getting quotas for user 45b6f8ac55464fc99331221b6c67a85d and project f1d60fe3fdc841998824b803809f9e49. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:27:42.721507 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] [instance: 468c7efb-80de-4061-86c6-dd1eadbec954] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:27:42.722393 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:27:42.722790 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:27:42.778222 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] [instance: 468c7efb-80de-4061-86c6-dd1eadbec954] block_device_mapping [BlockDeviceMapping(attachment_id=12c44da5-207e-4c89-939e-22018623e040,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51002b9e-3891-4493-ad02-66fefc771dc2',volume_size=1,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:27:42.779529 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:27:42.779941 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:27:43.008691 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:27:43.009102 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-f6a519c7-c13a-4881-abac-6d623af8b809 tempest-TestShelveInstance-574938005 tempest-TestShelveInstance-574938005-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:27:52.697509 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:52.783355 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=15 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:52.929056 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:52.930560 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:55.238252 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:55.280077 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:59.077145 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:28:35.242590 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:28:35.284423 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:28:41.739814 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:29:15.241986 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:29:15.283859 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:29:35.245065 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:29:35.283491 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:29:55.288127 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:30:15.247858 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:30:19.402101 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:30:35.251074 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:30:35.290736 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:30:58.699481 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:31:09.534342 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:31:15.248353 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:15.288630 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:19.086123 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:31:35.251459 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:35.291674 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:55.259828 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:01.748188 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:32:01.849526 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=129816) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:32:01.871804 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:32:01.872214 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:32:02.053410 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:32:02.053823 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:32:02.054554 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:32:02.055239 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:32:02.070692 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Getting quotas for project 4490e1139a4046228fe39fbdc7973d20. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:32:02.076156 ncdv-master-1 nova-conductor[129816]: DEBUG nova.quota [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Getting quotas for user 77a17d04ccb1477cafd82ca23fd65328 and project 4490e1139a4046228fe39fbdc7973d20. Resources: {'ram', 'instances', 'cores'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:32:02.086919 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] [instance: d9d4d400-1fed-4996-9d09-dd0dddd7fc42] Selected host: nch1-master-1; Selected node: nch1-master-1; Alternates: [('nch2-master-1', 'nch2-master-1')] {{(pid=129816) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:32:02.088038 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:32:02.088449 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:32:02.129057 ncdv-master-1 nova-conductor[129816]: DEBUG nova.conductor.manager [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] [instance: d9d4d400-1fed-4996-9d09-dd0dddd7fc42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:32:02.130338 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:32:02.130743 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:32:02.363052 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:32:02.363525 ncdv-master-1 nova-conductor[129816]: DEBUG oslo_concurrency.lockutils [None req-dda50cff-7c75-4669-ad15-366e43cbcdfb tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:32:12.061668 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:12.134235 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=9,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=18,nova_cell1:RELEASE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:12.266352 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:12.266986 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:15.297565 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=15,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:25.260196 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:35.305055 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:55.271832 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:33:05.316147 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:33:12.836556 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:33:15.654973 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:33:35.284801 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:33:35.322755 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:33:39.410173 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:33:55.293254 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:33:55.333649 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:15.341139 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:18.707872 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:34:26.984406 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=129815) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:911}} Jul 16 22:34:27.005378 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:34:27.005792 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:34:27.202257 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:27.204523 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:34:27.204936 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:34:27.205678 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:34:27.206129 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:34:27.222252 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Getting quotas for project 4490e1139a4046228fe39fbdc7973d20. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 22:34:27.227083 ncdv-master-1 nova-conductor[129815]: DEBUG nova.quota [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Getting quotas for user 77a17d04ccb1477cafd82ca23fd65328 and project 4490e1139a4046228fe39fbdc7973d20. Resources: {'ram', 'instances', 'cores'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 22:34:27.239065 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] [instance: 2cd73456-1037-4243-8aa3-2a93c28b8f96] Selected host: nch2-master-1; Selected node: nch2-master-1; Alternates: [('nch1-master-1', 'nch1-master-1')] {{(pid=129815) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1660}} Jul 16 22:34:27.239949 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:34:27.240359 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:34:27.332254 ncdv-master-1 nova-conductor[129815]: DEBUG nova.conductor.manager [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] [instance: 2cd73456-1037-4243-8aa3-2a93c28b8f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5bd35c9f-f30e-44b1-bf6e-dbe1feb40ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Jul 16 22:34:27.333471 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:34:27.333878 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:34:27.590670 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 22:34:27.591116 ncdv-master-1 nova-conductor[129815]: DEBUG oslo_concurrency.lockutils [None req-dd91bba1-813f-4549-a24a-9c3b3e0c80d7 tempest-TestSnapshotPattern-959556747 tempest-TestSnapshotPattern-959556747-project] Lock "327e8df1-39cc-4b36-9ea6-6a9b88ed54fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 22:34:29.542775 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:34:37.212606 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:37.337038 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=25 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:37.436521 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:37.529175 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:39.094105 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:34:55.343554 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:35:05.283884 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:35:21.755959 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:35:35.344039 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:35:45.285424 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:35:55.350289 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:05.294726 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:25.302823 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:25.357170 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:59.417964 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:37:05.309993 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:37:05.349960 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:37:38.719907 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:37:45.308521 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:37:45.360010 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:37:49.550871 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:37:59.102553 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:38:25.313597 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:38:25.362180 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:38:41.764029 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:39:05.309743 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:39:05.361018 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:39:25.316425 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:39:25.366863 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:39:45.322682 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:39:45.374035 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:39:52.849602 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:39:55.665767 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:40:15.328720 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:40:15.376517 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:40:19.426612 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:40:55.329372 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:40:55.370077 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:40:58.729336 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:41:09.559675 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:41:15.379618 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:41:19.110629 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:41:25.342564 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:41:45.389746 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:42:01.772639 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:42:05.346254 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:42:25.391776 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:42:35.353128 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:43:05.389793 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:43:12.857053 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:43:15.349115 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:43:15.673590 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:43:35.351610 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:43:35.392329 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:43:39.434150 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:43:55.397419 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:44:15.358107 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:44:18.737098 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:44:29.567313 ncdv-master-1 nova-conductor[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 22:44:35.360636 ncdv-master-1 nova-conductor[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:44:35.402835 ncdv-master-1 nova-conductor[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:44:39.120889 ncdv-master-1 nova-conductor[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer