-- Logs begin at Thu 2021-12-16 06:42:24 UTC, end at Thu 2021-12-16 09:19:34 UTC. -- Dec 16 07:19:04.426448 n-d-816927-3 systemd[1]: Started Devstack devstack@n-super-cond.service. Dec 16 07:19:07.647403 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_db.sqlalchemy.engines [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:19:07.866920 n-d-816927-3 nova-conductor[88971]: DEBUG nova.context [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) {{(pid=88971) load_cells /opt/stack/nova/nova/context.py:465}} Dec 16 07:19:07.870722 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_concurrency.lockutils [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:19:07.872354 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_concurrency.lockutils [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:19:07.873627 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_concurrency.lockutils [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:19:07.874984 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_concurrency.lockutils [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:19:07.905078 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_db.sqlalchemy.engines [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:19:07.918534 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_db.sqlalchemy.engines [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:19:07.926624 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_concurrency.lockutils [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Acquired lock "singleton_lock" {{(pid=88971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 07:19:07.927484 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_concurrency.lockutils [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Releasing lock "singleton_lock" {{(pid=88971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 07:19:07.928226 n-d-816927-3 nova-conductor[88971]: INFO oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Starting 2 workers Dec 16 07:19:07.932866 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Started child 89856 {{(pid=88971) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Dec 16 07:19:07.937360 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Started child 89857 {{(pid=88971) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Dec 16 07:19:07.938567 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Full set of CONF: {{(pid=88971) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Dec 16 07:19:07.938968 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ******************************************************************************** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 07:19:07.939291 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] Configuration options gathered from: {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 07:19:07.939679 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 07:19:07.940336 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] config files: ['/etc/nova/nova.conf'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 07:19:07.940646 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ================================================================================ {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 07:19:07.941340 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] allow_resize_to_same_host = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.941928 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] arq_binding_timeout = 300 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.942360 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] bandwidth_poll_interval = 600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.942822 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] bindir = /usr/local/bin {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.943246 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] block_device_allocate_retries = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.943683 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] block_device_allocate_retries_interval = 3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.944099 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cert = self.pem {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.944488 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute_driver = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.944947 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute_monitors = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.945423 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] config_dir = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.945878 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] config_drive_format = iso9660 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.946219 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.946646 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] config_source = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.947043 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] console_host = n-d-816927-3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.947477 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] control_exchange = nova {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.947911 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cpu_allocation_ratio = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.948267 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] daemon = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.948708 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] debug = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.949088 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] default_access_ip_network_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.949524 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] default_availability_zone = nova {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.949935 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] default_ephemeral_format = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.950569 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.951354 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] default_schedule_zone = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.951603 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] disk_allocation_ratio = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.952406 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] enable_new_services = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.953168 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] enabled_apis = ['osapi_compute'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.953827 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] enabled_ssl_apis = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.954495 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] flat_injected = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.955163 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] force_config_drive = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.955805 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] force_raw_images = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.956455 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] graceful_shutdown_timeout = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.956937 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] heal_instance_info_cache_interval = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.957369 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] host = n-d-816927-3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.957876 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.958311 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] initial_disk_allocation_ratio = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.958708 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] initial_ram_allocation_ratio = 1.5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.958885 n-d-816927-3 nova-conductor[89857]: INFO nova.service [-] Starting conductor node (version 22.3.1) Dec 16 07:19:07.959385 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.959713 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] instance_build_timeout = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.960105 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] instance_delete_interval = 300 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.960528 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] instance_format = [instance: %(uuid)s] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.960896 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] instance_name_template = instance-%08x {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.961291 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] instance_usage_audit = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.961715 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] instance_usage_audit_period = month {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.962223 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.962630 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] instances_path = /opt/stack/data/nova/instances {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.963017 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] internal_service_availability_zone = internal {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.963387 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] key = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.963769 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] live_migration_retry_count = 30 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.964166 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] log_config_append = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.964549 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.964953 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] log_dir = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.965438 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] log_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.965625 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] log_options = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.966172 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] log_rotate_interval = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.966516 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] log_rotate_interval_type = days {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.966963 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] log_rotation_type = none {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.967330 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.967953 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.968051 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.968426 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.968735 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.969246 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] long_rpc_timeout = 1800 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.969529 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] max_concurrent_builds = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.969919 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] max_concurrent_live_migrations = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.970318 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] max_concurrent_snapshots = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.971085 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] max_local_block_devices = 3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.971085 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] max_logfile_count = 30 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.971457 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] max_logfile_size_mb = 200 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.971821 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] maximum_instance_delete_attempts = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.972198 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] metadata_listen = 0.0.0.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.972670 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] metadata_listen_port = 8775 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.973064 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] metadata_workers = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.973434 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] migrate_max_retries = -1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.973845 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] mkisofs_cmd = genisoimage {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.974351 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] my_block_storage_ip = 10.222.0.13 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.974663 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] my_ip = 10.222.0.13 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.975069 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] network_allocate_retries = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.975446 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.975830 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] osapi_compute_listen = 0.0.0.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.976207 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] osapi_compute_listen_port = 8774 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.976604 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] osapi_compute_unique_server_name_scope = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.976968 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] osapi_compute_workers = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.977352 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] password_length = 12 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.977732 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] periodic_enable = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.978147 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] periodic_fuzzy_delay = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.978528 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] pointer_model = usbtablet {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.979230 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] preallocate_images = none {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.979326 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] publish_errors = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.979640 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] pybasedir = /opt/stack/nova {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.980002 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ram_allocation_ratio = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.980390 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] rate_limit_burst = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.980818 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] rate_limit_except_level = CRITICAL {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.981689 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] rate_limit_interval = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.981689 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] reboot_timeout = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.982484 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] reclaim_instance_interval = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.982860 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] record = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.983289 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] report_interval = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.983681 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] rescue_timeout = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.984074 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] reserved_host_cpus = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.984452 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] reserved_host_disk_mb = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.984684 n-d-816927-3 nova-conductor[89856]: INFO nova.service [-] Starting conductor node (version 22.3.1) Dec 16 07:19:07.985371 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] reserved_host_memory_mb = 512 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.985823 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] reserved_huge_pages = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.986210 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] resize_confirm_window = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.986601 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] resize_fs_using_block_device = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.986950 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] resume_guests_state_on_host_boot = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.987361 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.987781 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] rpc_response_timeout = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.988167 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] run_external_periodic_tasks = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.988566 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] running_deleted_instance_action = reap {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.988936 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.989303 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] running_deleted_instance_timeout = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.989669 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler_instance_sync_interval = 120 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.990083 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_down_time = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.990505 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] servicegroup_driver = db {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.990879 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] shelved_offload_time = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.991246 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] shelved_poll_interval = 3600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.991633 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] shutdown_timeout = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.992004 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] source_is_ipv6 = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.992384 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ssl_only = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.992764 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] state_path = /opt/stack/data/nova {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.993150 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] sync_power_state_interval = 600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.993546 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] sync_power_state_pool_size = 1000 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.993970 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] syslog_log_facility = LOG_USER {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.994344 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] tempdir = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.994732 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] timeout_nbd = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.995136 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] transport_url = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.995748 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] update_resources_interval = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:07.999424 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] use_cow_images = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.000141 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] use_eventlog = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.000599 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] use_journal = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.001813 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] use_json = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.001813 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] use_rootwrap_daemon = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.001813 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] use_stderr = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.002211 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] use_syslog = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.006084 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vcpu_pin_set = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.006549 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vif_plugging_is_fatal = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.006962 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vif_plugging_timeout = 300 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.007434 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] virt_mkfs = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.007825 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] volume_usage_poll_interval = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.008207 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] watch_log_file = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.008635 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] web = /usr/share/spice-html5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 07:19:08.009171 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_concurrency.disable_process_locking = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.009988 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.010062 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.auth_strategy = keystone {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.010465 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.compute_link_prefix = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.010882 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.011284 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.dhcp_domain = novalocal {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.011670 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.enable_instance_password = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.012067 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.glance_link_prefix = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.012503 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.012918 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.013303 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.instance_list_per_project_cells = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.014983 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.list_records_by_skipping_down_cells = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.015400 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.local_metadata_per_cell = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.015969 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.max_limit = 1000 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.016371 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.metadata_cache_expiration = 15 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.017572 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_db.sqlalchemy.engines [None req-4c6fd776-dffd-4cbb-b079-d8a2259f39ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:19:08.017714 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.neutron_default_tenant_id = default {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.018121 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.use_forwarded_for = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.019168 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.use_neutron_default_nets = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.019558 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.019953 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.020345 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.020742 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.021169 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.vendordata_dynamic_targets = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.021547 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.vendordata_jsonfile_path = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.022001 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.022487 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.backend = dogpile.cache.memcached {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.022886 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.backend_argument = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.023295 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.config_prefix = cache.oslo {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.023673 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.debug_cache_backend = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.024280 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.enabled = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.024698 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.expiration_time = 600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.025073 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.memcache_dead_retry = 300 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.025459 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.025881 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.memcache_pool_maxsize = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.027642 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.028083 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.028486 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.memcache_socket_timeout = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.028891 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.proxies = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.029306 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.tls_allowed_ciphers = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.031795 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.tls_cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.032202 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.tls_certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.032620 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.tls_enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.033950 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cache.tls_keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.034643 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.auth_section = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.035266 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.auth_type = password {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.036051 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.037046 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.catalog_info = volumev3::publicURL {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.038281 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.038881 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.039492 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.cross_az_attach = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.040548 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.endpoint_template = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.041148 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.http_retries = 3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.041422 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_db.sqlalchemy.engines [None req-cad12c06-6b23-481f-a397-0398c967a113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:19:08.042022 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.042622 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.043228 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.os_region_name = RegionOne {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.043813 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.044400 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cinder.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.045065 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.045642 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.cpu_dedicated_set = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.046243 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.cpu_shared_set = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.046941 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.047561 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.048174 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.048768 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.049391 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.resource_provider_association_refresh = 300 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.050031 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] compute.shutdown_retry_interval = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.051035 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] conductor.workers = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.051682 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] console.allowed_origins = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.053111 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] console.ssl_ciphers = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.053712 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] console.ssl_minimum_version = default {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.054345 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] consoleauth.token_ttl = 600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.054962 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.055582 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.056163 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.056904 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.connect_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.057484 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.connect_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.058244 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.endpoint_override = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.058845 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.059431 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.060026 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.max_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.060995 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.min_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.061585 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.region_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.062176 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.service_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.062805 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.service_type = accelerator {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.063384 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.064469 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.status_code_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.065050 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.status_code_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.065622 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.066290 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.067010 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] cyborg.version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.067638 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.backend = sqlalchemy {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.068312 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.connection = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.068919 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.connection_debug = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.069531 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.connection_parameters = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.070197 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.connection_recycle_time = 3600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.070999 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.connection_trace = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.071590 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.db_inc_retry_interval = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.072173 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.db_max_retries = 20 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.073005 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.db_max_retry_interval = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.073405 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.db_retry_interval = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.073890 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.max_overflow = 50 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.074368 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.max_pool_size = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.074829 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.max_retries = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.075372 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.mysql_enable_ndb = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.075860 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.076342 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.pool_timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.076816 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.retry_interval = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.077563 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.slave_connection = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.078030 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.sqlite_synchronous = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.078515 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.use_db_reconnect = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.078974 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] database.use_tpool = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.079446 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.connection = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.079898 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.connection_debug = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.080361 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.connection_parameters = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.081029 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.connection_recycle_time = 3600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.081467 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.connection_trace = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.081940 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.max_overflow = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.082385 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.max_pool_size = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.082860 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.max_retries = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.083306 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.083734 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.pool_timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.084026 n-d-816927-3 nova-conductor[89857]: DEBUG nova.service [None req-4c6fd776-dffd-4cbb-b079-d8a2259f39ec None None] Creating RPC server for service conductor {{(pid=89857) start /opt/stack/nova/nova/service.py:182}} Dec 16 07:19:08.084179 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.retry_interval = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.084635 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.slave_connection = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.085122 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] api_database.sqlite_synchronous = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.085633 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] devices.enabled_vgpu_types = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.086162 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.086598 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ephemeral_storage_encryption.enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.087215 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.087711 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.allowed_direct_url_schemes = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.088200 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.api_servers = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.088637 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.089127 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.089602 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.090025 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.connect_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.090456 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.connect_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.091148 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.debug = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.091642 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.default_trusted_certificate_ids = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.092135 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.enable_certificate_validation = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.092586 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.enable_rbd_download = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.093013 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.endpoint_override = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.093498 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.093961 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.094397 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.max_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.094824 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.min_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.095300 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.num_retries = 3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.095750 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.rbd_ceph_conf = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.096207 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.rbd_connect_timeout = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.096658 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.rbd_pool = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.097103 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.rbd_user = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.097680 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.region_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.098144 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.service_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.098592 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.service_type = image {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.099041 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.099474 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.status_code_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.099907 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.status_code_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.100342 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.100815 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.101478 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.verify_glance_signatures = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.101949 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] glance.version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.102394 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] guestfs.debug = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.102889 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.config_drive_cdrom = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.103328 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.config_drive_inject_password = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.103778 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.104056 n-d-816927-3 nova-conductor[89856]: DEBUG nova.service [None req-cad12c06-6b23-481f-a397-0398c967a113 None None] Creating RPC server for service conductor {{(pid=89856) start /opt/stack/nova/nova/service.py:182}} Dec 16 07:19:08.104211 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.104689 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.enable_remotefx = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.105135 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.instances_path_share = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.105625 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.iscsi_initiator_list = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.106094 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.limit_cpu_features = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.106533 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.106993 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.107584 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.108114 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.108686 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.109123 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.use_multipath_io = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.109604 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.110066 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.110501 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.vswitch_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.110942 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.111577 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] mks.enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.112676 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.113164 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] image_cache.manager_interval = 2400 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.113607 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] image_cache.precache_concurrency = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.114125 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] image_cache.remove_unused_base_images = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.114569 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.115015 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.115482 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] image_cache.subdirectory_name = _base {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.115969 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.api_max_retries = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.116411 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.api_retry_interval = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.116844 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.auth_section = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.117284 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.auth_type = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.117821 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.118255 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.118695 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.119164 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.connect_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.119604 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.connect_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.120040 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.endpoint_override = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.120475 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.120906 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.121527 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.max_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.122011 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.min_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.122474 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.partition_key = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.122966 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.peer_list = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.123447 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.region_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.123902 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.serial_console_state_timeout = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.124335 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.service_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.124792 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.service_type = baremetal {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.125225 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.125653 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.status_code_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.126103 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.status_code_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.126527 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.126999 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.127432 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ironic.version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.128017 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.128479 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] key_manager.fixed_key = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.128988 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.129447 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.barbican_api_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.129944 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.barbican_endpoint = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.130421 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.barbican_endpoint_type = public {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.131114 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.131722 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.132164 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.132614 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.133041 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.133498 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.number_of_retries = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.133965 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.retry_delay = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.134400 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.134846 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.135290 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.verify_ssl = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.135727 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] barbican.verify_ssl_path = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.136188 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.approle_role_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.136624 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.approle_secret_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.137060 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.137491 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.138075 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.138578 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.139012 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.139527 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.kv_mountpoint = secret {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.140003 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.kv_version = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.140445 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.root_token_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.140879 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.141309 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.ssl_ca_crt_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.141937 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.142504 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.use_ssl = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.142990 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.143484 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.143921 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.144361 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.144811 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.connect_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.145264 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.connect_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.145698 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.endpoint_override = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.146196 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.146632 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.147069 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.max_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.147505 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.min_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.148039 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.region_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.148480 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.service_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.148938 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.service_type = identity {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.149369 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.149820 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.status_code_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.150262 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.status_code_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.150712 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.151184 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.151748 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] keystone.version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.152361 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.connection_uri = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.152827 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.cpu_mode = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.153282 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.cpu_model_extra_flags = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.153728 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.cpu_models = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.154420 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.disk_cachemodes = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.154913 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.disk_prefix = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.155483 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.enabled_perf_events = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.155870 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.file_backed_memory = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.156328 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.gid_maps = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.156781 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.hw_disk_discard = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.157211 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.hw_machine_type = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.157659 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.images_rbd_ceph_conf = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.158215 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.158695 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.159115 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.images_rbd_glance_store_name = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.159563 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.images_rbd_pool = rbd {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.160029 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.images_type = default {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.160460 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.images_volume_group = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.160895 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.inject_key = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.161345 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.inject_partition = -2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.161899 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.inject_password = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.162489 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.iscsi_iface = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.162925 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.iser_use_multipath = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.163365 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.163814 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.164250 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_downtime = 500 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.164708 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.165129 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.165597 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_inbound_addr = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.168832 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.168832 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.169305 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_scheme = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.169827 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_timeout_action = abort {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.170299 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_tunnelled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.171373 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_uri = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.171833 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.live_migration_with_native_tls = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.173634 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.max_queues = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.173634 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.174897 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.nfs_mount_options = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.175121 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.176399 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.176558 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.num_iser_scan_tries = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.178647 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.179966 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.180953 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.num_pcie_ports = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.181063 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.num_volume_scan_tries = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.181387 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.pmem_namespaces = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.181827 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.quobyte_client_cfg = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.184315 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.184315 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rbd_connect_timeout = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.184315 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.184315 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.184660 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rbd_secret_uuid = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.185646 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rbd_user = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.186801 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.186926 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.187247 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rescue_image_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.187691 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rescue_kernel_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.188160 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rescue_ramdisk_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.189763 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.189763 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.rx_queue_size = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.190680 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.smbfs_mount_options = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.191778 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.192504 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.snapshot_compression = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.193601 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.snapshot_image_format = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.194407 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.196578 n-d-816927-3 nova-conductor[89857]: DEBUG nova.service [None req-4c6fd776-dffd-4cbb-b079-d8a2259f39ec None None] Join ServiceGroup membership for this service conductor {{(pid=89857) start /opt/stack/nova/nova/service.py:199}} Dec 16 07:19:08.197041 n-d-816927-3 nova-conductor[89857]: DEBUG nova.servicegroup.drivers.db [None req-4c6fd776-dffd-4cbb-b079-d8a2259f39ec None None] DB_Driver: join new ServiceGroup member n-d-816927-3 to the conductor group, service = {{(pid=89857) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Dec 16 07:19:08.198893 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.sparse_logical_volumes = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.199394 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.swtpm_enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.199858 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.swtpm_group = tss {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.200715 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.swtpm_user = tss {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.201152 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.sysinfo_serial = unique {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.201543 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.tx_queue_size = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.201999 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.uid_maps = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.202502 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.use_usb_tablet = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.202978 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.use_virtio_for_bridges = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.203377 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.virt_type = kvm {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.203829 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.volume_clear = zero {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.204218 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.volume_clear_size = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.204535 n-d-816927-3 nova-conductor[89856]: DEBUG nova.service [None req-cad12c06-6b23-481f-a397-0398c967a113 None None] Join ServiceGroup membership for this service conductor {{(pid=89856) start /opt/stack/nova/nova/service.py:199}} Dec 16 07:19:08.204647 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.volume_use_multipath = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.204965 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.vzstorage_cache_path = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.205356 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.205651 n-d-816927-3 nova-conductor[89856]: DEBUG nova.servicegroup.drivers.db [None req-cad12c06-6b23-481f-a397-0398c967a113 None None] DB_Driver: join new ServiceGroup member n-d-816927-3 to the conductor group, service = {{(pid=89856) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Dec 16 07:19:08.205848 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.vzstorage_mount_group = qemu {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.206179 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.vzstorage_mount_opts = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.206592 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.207078 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.207475 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.vzstorage_mount_user = stack {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.207850 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.208247 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.208774 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.auth_section = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.209172 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.auth_type = password {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.209540 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.209966 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.210340 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.210705 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.connect_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.211077 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.connect_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.211464 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.default_floating_pool = public {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.211846 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.endpoint_override = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.212217 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.extension_sync_interval = 600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.212706 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.http_retries = 3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.213178 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.213549 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.213940 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.max_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.214343 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.214706 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.min_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.215087 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.ovs_bridge = br-int {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.215458 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.physnets = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.215838 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.region_name = RegionOne {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.216223 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.service_metadata_proxy = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.216637 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.service_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.217036 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.service_type = network {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.217406 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.217806 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.status_code_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.218157 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.status_code_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.218524 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.219021 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.219388 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] neutron.version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.219775 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] notifications.bdms_in_notifications = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.220176 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] notifications.default_level = INFO {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.220571 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] notifications.notification_format = unversioned {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.220935 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] notifications.notify_on_state_change = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.221323 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.221741 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] pci.alias = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.222171 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] pci.passthrough_whitelist = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.222621 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.auth_section = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.223048 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.auth_type = password {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.223451 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.auth_url = http://10.222.0.13/identity {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.223819 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.224188 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.224575 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.224938 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.connect_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.225307 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.connect_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.225693 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.default_domain_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.226078 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.default_domain_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.226448 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.domain_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.226812 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.domain_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.227180 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.endpoint_override = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.227550 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.227917 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.228280 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.max_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.228651 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.min_version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.229137 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.password = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.229511 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.project_domain_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.229917 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.project_domain_name = Default {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.230321 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.project_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.230723 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.project_name = service {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.231293 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.region_name = RegionOne {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.231668 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.service_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.232053 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.service_type = placement {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.232462 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.232828 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.status_code_retries = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.233196 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.status_code_retry_delay = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.233563 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.system_scope = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.233951 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.234323 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.trust_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.234689 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.user_domain_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.235068 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.user_domain_name = Default {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.235431 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.user_id = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.235830 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.username = placement {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.236230 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.236601 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] placement.version = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.237059 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] powervm.disk_driver = localdisk {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.237444 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] powervm.proc_units_factor = 0.1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.237850 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] powervm.volume_group_name = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.238254 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.cores = 20 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.238621 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.count_usage_from_placement = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.239034 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.239430 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.injected_file_content_bytes = 10240 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.239810 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.injected_file_path_length = 255 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.240187 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.injected_files = 5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.240560 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.instances = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.240930 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.key_pairs = 100 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.241317 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.metadata_items = 128 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.241687 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.ram = 51200 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.242080 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.recheck_quota = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.242467 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.server_group_members = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.242854 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] quota.server_groups = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.243256 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] rdp.enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.243854 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.244289 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.244686 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.driver = filter_scheduler {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.245057 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.245427 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.image_metadata_prefilter = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.245825 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.246209 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.max_attempts = 3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.246586 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.max_placement_results = 1000 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.246957 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.periodic_task_interval = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.247327 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.247704 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.query_placement_for_availability_zone = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.248125 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.248514 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] scheduler.workers = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.248919 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.249310 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.249732 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.250133 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.250508 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.250895 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.251270 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.251701 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.252089 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.host_subset_size = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.252453 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.252845 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.253223 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.isolated_hosts = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.253708 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.isolated_images = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.254105 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.254503 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.254883 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.255256 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.255628 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.256005 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.256373 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.256760 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.257149 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.track_instance_changes = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.257545 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.257948 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] metrics.required = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.258318 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] metrics.weight_multiplier = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.258689 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.259106 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] metrics.weight_setting = [] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.259681 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.260047 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] serial_console.enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.260451 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] serial_console.port_range = 10000:20000 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.260832 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.261216 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.261595 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] serial_console.serialproxy_port = 6083 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.261992 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.auth_section = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.262361 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.auth_type = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.262722 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.263082 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.263577 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.263874 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.264234 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.264603 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.send_service_user_token = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.264980 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.265340 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] service_user.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.265716 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] spice.agent_enabled = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.266118 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] spice.enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.266732 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.267208 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.267583 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] spice.html5proxy_port = 6082 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.267971 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] spice.server_listen = 127.0.0.1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.268352 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.268729 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] upgrade_levels.baseapi = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.269096 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] upgrade_levels.cert = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.269476 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] upgrade_levels.compute = auto {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.269861 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] upgrade_levels.conductor = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.270229 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] upgrade_levels.scheduler = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.270604 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.270996 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.271363 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.cafile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.271726 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.certfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.272092 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.272456 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.272824 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.273194 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.273559 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vendordata_dynamic_auth.timeout = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.274017 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.api_retry_count = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.274387 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.ca_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.274761 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.cache_prefix = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.275128 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.cluster_name = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.275505 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.connection_pool_size = 10 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.275867 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.console_delay_seconds = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.276237 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.datastore_regex = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.276595 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.host_ip = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.276959 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.host_password = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.277330 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.host_port = 443 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.277693 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.host_username = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.278178 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.insecure = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.278468 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.integration_bridge = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.278841 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.maximum_objects = 100 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.279256 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.pbm_default_policy = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.279625 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.pbm_enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.279985 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.pbm_wsdl_location = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.280362 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.280723 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.serial_port_proxy_uri = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.281089 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.serial_port_service_uri = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.281465 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.task_poll_interval = 0.5 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.281852 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.use_linked_clone = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.282273 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.vnc_keymap = en-us {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.282602 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.vnc_port = 5900 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.283019 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vmware.vnc_port_total = 10000 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.283465 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.auth_schemes = ['none'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.283838 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.enabled = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.284408 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.284795 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.285174 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.novncproxy_port = 6080 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.285604 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.server_listen = 127.0.0.1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.285984 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.286376 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.vencrypt_ca_certs = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.286738 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.vencrypt_client_cert = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.287100 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] vnc.vencrypt_client_key = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.287479 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.287854 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.288225 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.288597 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.disable_native_luksv1 = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.288966 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.disable_rootwrap = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.289343 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.enable_numa_live_migration = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.289718 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.290118 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.290487 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.290879 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.rbd_volume_local_attach = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.291252 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.291715 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.292112 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.client_socket_timeout = 900 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.292495 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.default_pool_size = 1000 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.292867 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.keep_alive = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.293246 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.max_header_line = 16384 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.293616 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.secure_proxy_ssl_header = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.294016 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.ssl_ca_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.294397 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.ssl_cert_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.294800 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.ssl_key_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.295177 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.tcp_keepidle = 600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.295761 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.295971 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] zvm.ca_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.296336 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] zvm.cloud_connector_url = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.296790 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.297299 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] zvm.reachable_timeout = 300 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.297594 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.enforce_new_defaults = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.297989 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.enforce_scope = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.298389 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.policy_default_rule = default {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.298811 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.299202 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.policy_file = policy.yaml {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.299618 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.299989 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.300352 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.300718 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.301092 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.301490 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.302311 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.connection_string = messaging:// {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.302705 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.enabled = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.303106 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.es_doc_type = notification {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.303485 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.es_scroll_size = 10000 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.303864 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.es_scroll_time = 2m {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.304232 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.filter_error_trace = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.304637 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.hmac_keys = SECRET_KEY {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.305023 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.sentinel_service_name = mymaster {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.305412 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.socket_timeout = 0.1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.305925 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] profiler.trace_sqlalchemy = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.306201 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] remote_debug.host = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.306573 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] remote_debug.port = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.306979 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.307350 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.307729 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.308100 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.308482 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.308853 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.309226 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.309613 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.310018 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.310445 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.310839 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.311223 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.311612 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.311988 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.312365 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.312755 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.313123 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.313509 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.313911 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.314291 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.314692 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.315080 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.ssl = False {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.315472 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.315862 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.316251 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.316668 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.317100 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.317474 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_notifications.retry = -1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.317900 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.318285 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.318691 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_reports.file_event_handler = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.319073 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.319459 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] oslo_reports.log_dir = None {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 07:19:08.319765 n-d-816927-3 nova-conductor[88971]: DEBUG oslo_service.service [None req-cc4b2751-172b-47fe-85cf-f8d3976aa7e1 None None] ******************************************************************************** {{(pid=88971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 07:22:08.179287 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:22:08.188041 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:22:09.204221 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47146. Dec 16 07:22:09.211968 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47148. Dec 16 07:25:09.199362 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:25:09.207584 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:25:10.236009 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47208. Dec 16 07:25:10.239420 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47210. Dec 16 07:28:10.226442 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:28:10.232863 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:28:11.251443 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47334. Dec 16 07:28:11.257802 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47336. Dec 16 07:28:32.275660 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_db.sqlalchemy.engines [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Parent process 88971 forked (89857) with an open database connection, which is being discarded and recreated. {{(pid=89857) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Dec 16 07:28:33.194896 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:28:33.234938 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:33.238223 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:33.262973 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_db.sqlalchemy.engines [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:28:33.446059 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:33.447601 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:33.448333 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:33.448716 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:33.488902 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_db.sqlalchemy.engines [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:28:33.536343 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Getting quotas for project 5c2d4ee44e204503a0258e6685636644. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:28:33.544727 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Getting quotas for user 3266cb2fa654460b9004729125181d47 and project 5c2d4ee44e204503a0258e6685636644. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:28:33.595292 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] [instance: 9ae6124f-e650-4d97-95b2-0235ff1aac2f] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:28:33.596357 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:33.596868 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:33.619976 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] [instance: 9ae6124f-e650-4d97-95b2-0235ff1aac2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:28:33.625176 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:33.625762 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:33.728054 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:33.729287 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:33.729980 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c35377f3-7260-4091-ba9f-0f85db920977 tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Acquired lock "compute-rpcapi-router" {{(pid=89857) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 07:28:33.732125 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-047ee11a-298c-499a-bf18-9029c2ddb69b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:33.744803 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-047ee11a-298c-499a-bf18-9029c2ddb69b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:33.745652 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-047ee11a-298c-499a-bf18-9029c2ddb69b None None] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:33.746079 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-047ee11a-298c-499a-bf18-9029c2ddb69b None None] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:33.766754 n-d-816927-3 nova-conductor[89857]: INFO nova.compute.rpcapi [None req-047ee11a-298c-499a-bf18-9029c2ddb69b None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 16 07:28:33.767714 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-047ee11a-298c-499a-bf18-9029c2ddb69b None None] Releasing lock "compute-rpcapi-router" {{(pid=89857) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 07:28:35.904816 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_db.sqlalchemy.engines [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Parent process 88971 forked (89856) with an open database connection, which is being discarded and recreated. {{(pid=89856) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Dec 16 07:28:36.568171 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:28:36.707482 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:36.712509 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:36.745800 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_db.sqlalchemy.engines [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:28:37.002747 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:37.009211 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:37.011826 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:37.012217 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:37.070273 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_db.sqlalchemy.engines [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 07:28:37.120054 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Getting quotas for project b776c5b7773742b382a89cd0e023f0eb. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:28:37.138746 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Getting quotas for user 7687a7f7ed734560a478836c2a644650 and project b776c5b7773742b382a89cd0e023f0eb. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:28:37.163409 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] [instance: b0027afe-9716-440c-bc39-6a2d141cfc45] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:28:37.165933 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:37.166645 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:37.193845 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] [instance: b0027afe-9716-440c-bc39-6a2d141cfc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:28:37.199578 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:37.202827 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:37.340489 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:37.341395 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:37.343309 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d6b672a-c3fa-48db-8905-6f1373848143 tempest-AggregatesAdminTestJSON-824442828 tempest-AggregatesAdminTestJSON-824442828-project] Acquired lock "compute-rpcapi-router" {{(pid=89856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 07:28:37.344776 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e50aaf3a-aa78-44eb-b0a9-1bf8198bcbdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:37.364153 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e50aaf3a-aa78-44eb-b0a9-1bf8198bcbdf None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:37.366376 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e50aaf3a-aa78-44eb-b0a9-1bf8198bcbdf None None] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:28:37.368612 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e50aaf3a-aa78-44eb-b0a9-1bf8198bcbdf None None] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:28:37.389330 n-d-816927-3 nova-conductor[89856]: INFO nova.compute.rpcapi [None req-e50aaf3a-aa78-44eb-b0a9-1bf8198bcbdf None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 16 07:28:37.390571 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e50aaf3a-aa78-44eb-b0a9-1bf8198bcbdf None None] Releasing lock "compute-rpcapi-router" {{(pid=89856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 07:29:05.213624 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:29:05.265940 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:05.266386 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:05.324062 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:05.324453 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:05.325359 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:05.326052 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:05.348547 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Getting quotas for project 5c2d4ee44e204503a0258e6685636644. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:29:05.353178 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Getting quotas for user 3266cb2fa654460b9004729125181d47 and project 5c2d4ee44e204503a0258e6685636644. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:29:05.369522 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] [instance: 1ac32fde-5f99-4d11-8c80-c09b5533a0a8] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:29:05.370998 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:05.371430 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:05.381299 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] [instance: 1ac32fde-5f99-4d11-8c80-c09b5533a0a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:29:05.383070 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:05.383616 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:05.436701 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:05.437412 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2a52a640-2bed-4d42-b851-18fd193ea4dd tempest-DeleteServersAdminTestJSON-1308744492 tempest-DeleteServersAdminTestJSON-1308744492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:21.747606 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:29:21.804282 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:21.804570 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:21.911227 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:21.911951 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:21.912870 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:21.913490 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:21.932595 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:29:21.937653 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for user b84ce55416374bfbb71f613e163fd9f6 and project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:29:21.951854 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 71d440e5-0434-4c5f-a0c6-1b951fa362a7] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:29:21.952968 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:21.953590 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:21.966340 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 71d440e5-0434-4c5f-a0c6-1b951fa362a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:29:21.968000 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:21.969753 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:22.039500 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:22.040220 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3acf885b-2f9b-459d-8fd1-d9be3d53b1ed tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:39.253700 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:29:39.276920 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:39.277407 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:39.335566 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:39.336044 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:39.336802 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:39.337169 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:39.358542 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Getting quotas for project e8a823dfdf4841c7992572566bc0d958. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:29:39.366874 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Getting quotas for user dadf28eb154146f9b072b3f313386689 and project e8a823dfdf4841c7992572566bc0d958. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:29:39.379259 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: 15fb2802-931c-4e4d-bd6b-6d20de9c9ec0] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:29:39.380201 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:39.380591 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:39.390580 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: 15fb2802-931c-4e4d-bd6b-6d20de9c9ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:29:39.392456 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:39.393224 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:39.440141 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:39.440987 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-029f2ea5-4737-4beb-837c-369df339d6bf tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:41.079183 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:41.081983 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:41.735109 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Took 0.58 seconds to select destinations for 2 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:29:41.792620 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:41.793253 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:41.884542 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:41.885013 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:41.938511 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:41.939456 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:41.940334 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:41.940964 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:41.964314 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:29:41.969131 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for user b84ce55416374bfbb71f613e163fd9f6 and project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:29:41.980560 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 57471c63-6217-4520-8f1c-45875a86b246] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:29:41.982004 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:41.982549 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:41.993448 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 57471c63-6217-4520-8f1c-45875a86b246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:29:41.995159 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:41.995758 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:42.033988 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:42.034577 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:42.046101 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 8a842018-b4d4-4896-bcde-c4097b37b968] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:29:42.047053 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance_group [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lazy-loading 'hosts' on InstanceGroup uuid 97f4aacf-9cac-4858-b461-d32c84412789 {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Dec 16 07:29:42.093087 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:42.094418 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:42.117360 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 8a842018-b4d4-4896-bcde-c4097b37b968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:29:42.119628 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:42.120122 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:42.175826 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:42.176260 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-500a42b7-0aa2-4851-acd2-37d6c9e52e77 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:56.400668 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:29:56.434157 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:56.434615 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:56.542351 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:56.542753 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:56.551078 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:56.551707 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:56.581234 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Getting quotas for project 5bd297cc28d04c7da57b44d1aadd1b5a. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:29:56.589094 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Getting quotas for user 3a8f9ebffaeb4aff81e08df29d4d52ec and project 5bd297cc28d04c7da57b44d1aadd1b5a. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:29:56.614884 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] [instance: e133a8fb-20d3-4aa1-ac17-8cb07d2457c5] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:29:56.616942 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:56.617664 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:56.628467 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] [instance: e133a8fb-20d3-4aa1-ac17-8cb07d2457c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:29:56.630239 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:56.630865 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:29:56.690819 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:29:56.691284 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c33532c6-b221-45c8-a5b1-8b8930e47945 tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:02.826390 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:02.872341 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:02.872341 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:02.973797 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:02.974871 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:02.979652 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:02.980111 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:03.012076 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Getting quotas for project cb51c5f234e14095a5ab4f0bddd55a80. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:03.021826 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Getting quotas for user d795827761bd4d769297b3183f31d0ab and project cb51c5f234e14095a5ab4f0bddd55a80. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:03.042583 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] [instance: 0775d80b-f81f-4593-81c6-1dce8dfe1801] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:03.044548 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:03.047139 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:03.063784 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] [instance: 0775d80b-f81f-4593-81c6-1dce8dfe1801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:03.065432 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:03.066008 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:03.115772 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:03.116410 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-02a90967-f82d-4677-a23b-4f02badc47a2 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:07.209630 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:07.248121 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:07.248511 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:07.340320 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:07.340777 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:07.341674 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:07.342219 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:07.371464 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Getting quotas for project d3072867d3064da2bea47897c3bc1d0d. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:07.376715 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Getting quotas for user 67bf3e43f0a547b8bc6daf2dd366022f and project d3072867d3064da2bea47897c3bc1d0d. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:07.396974 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] [instance: 55bb0acf-0fd1-41ff-a92c-f343dce8b2cb] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:07.398159 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:07.398717 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:07.413153 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] [instance: 55bb0acf-0fd1-41ff-a92c-f343dce8b2cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:07.416333 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:07.416902 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:07.499161 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:07.499632 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93d68df4-61f8-464a-8ac8-da825e00189e tempest-TenantUsagesTestJSON-6608501 tempest-TenantUsagesTestJSON-6608501-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:09.317419 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-6d47dfe8-db73-4064-84f9-6845a876f7ae tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:30:09.320058 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d47dfe8-db73-4064-84f9-6845a876f7ae tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:09.320566 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6d47dfe8-db73-4064-84f9-6845a876f7ae tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:10.024045 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-6d47dfe8-db73-4064-84f9-6845a876f7ae tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] [instance: 15fb2802-931c-4e4d-bd6b-6d20de9c9ec0] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89856) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 07:30:10.413980 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-6d47dfe8-db73-4064-84f9-6845a876f7ae tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] Created allocations for migration 20c2650b-ac3e-4592-9ad1-f2efb7a25bc1 on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:30:10.716435 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-6d47dfe8-db73-4064-84f9-6845a876f7ae tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] [instance: 15fb2802-931c-4e4d-bd6b-6d20de9c9ec0] Calling prep_resize with selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89856) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 07:30:11.466743 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:11.491641 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:11.492445 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:11.552946 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:11.553382 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:11.554530 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:11.555000 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:11.571342 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Getting quotas for project 188801c96f1a4dab85517224b309cab9. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:11.575969 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Getting quotas for user c1f5f9645e844cb0866776c2cd55dd6a and project 188801c96f1a4dab85517224b309cab9. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:11.586426 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] [instance: 17715ec6-6d76-4280-84b0-11864a9440ac] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:11.587469 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:11.587950 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:11.599021 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] [instance: 17715ec6-6d76-4280-84b0-11864a9440ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:11.601042 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:11.602047 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:11.647344 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:11.647914 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5aea7b36-9b54-45af-8101-61c8fa14516b tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:19.415487 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:19.438330 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:19.438738 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:19.492807 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:19.493503 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:19.494288 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:19.494694 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:19.512390 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Getting quotas for project 7edcc310c84b4eab95508fbb8a5c981c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:19.517535 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Getting quotas for user 3939f1595aac4a4bb4288f7cc5e2691b and project 7edcc310c84b4eab95508fbb8a5c981c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:19.528685 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] [instance: bdf5833b-7d3f-4090-bed5-1322bbd446d9] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:19.529622 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:19.530048 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:19.538313 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] [instance: bdf5833b-7d3f-4090-bed5-1322bbd446d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:19.539510 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:19.539903 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:19.573433 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:19.573856 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9e47480b-a75f-4047-bff2-0a75ac3948e4 tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.106881 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.107414 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.500868 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Took 0.36 seconds to select destinations for 2 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:20.533408 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.534419 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.635880 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.636468 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.694580 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.695419 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.696351 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.697528 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.732804 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:20.742952 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for user b84ce55416374bfbb71f613e163fd9f6 and project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:20.755713 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: e693318a-84c0-4e38-b4d3-9e093932dda2] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:20.757153 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.757743 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.791681 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: e693318a-84c0-4e38-b4d3-9e093932dda2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:20.795113 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.795747 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.839738 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.840180 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.852525 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 5f799d59-ac70-4d14-b1cc-ca07c4797325] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:20.852959 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance_group [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lazy-loading 'hosts' on InstanceGroup uuid 1e138703-7520-44e4-92a3-239444a14ae9 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Dec 16 07:30:20.867355 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.867787 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.877247 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 5f799d59-ac70-4d14-b1cc-ca07c4797325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:20.878824 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.879229 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:20.941012 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:20.947582 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5e6092a2-420a-4a77-9ac4-294e8f48403d tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:23.343400 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:23.373078 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:23.373483 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:23.423900 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:23.424380 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:23.425374 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:23.425943 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:23.449635 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Getting quotas for project 5bd297cc28d04c7da57b44d1aadd1b5a. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:23.455563 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Getting quotas for user 3a8f9ebffaeb4aff81e08df29d4d52ec and project 5bd297cc28d04c7da57b44d1aadd1b5a. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:23.469324 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] [instance: 5d836e5b-3142-4dcf-a173-9de2912d621d] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:23.471025 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:23.471435 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:23.480483 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] [instance: 5d836e5b-3142-4dcf-a173-9de2912d621d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:23.482052 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:23.482641 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:23.517734 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:23.518401 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-89219786-b55c-4039-a407-842d49146eff tempest-LiveMigrationNegativeTest-1634829316 tempest-LiveMigrationNegativeTest-1634829316-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:24.625337 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:24.682592 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:24.684169 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:24.763002 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:24.763401 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:24.764097 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:24.764718 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:24.784379 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Getting quotas for project cb51c5f234e14095a5ab4f0bddd55a80. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:24.789395 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Getting quotas for user d795827761bd4d769297b3183f31d0ab and project cb51c5f234e14095a5ab4f0bddd55a80. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:24.801233 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] [instance: 6424d7ed-3d1a-4942-8569-b50e10b9c7cb] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:24.802423 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:24.802957 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:24.818095 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] [instance: 6424d7ed-3d1a-4942-8569-b50e10b9c7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:24.821916 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:24.823674 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:24.882358 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:24.884841 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-6df55102-3b0f-41a0-9b68-dacf1814b569 tempest-ServersAdminNegativeTestJSON-38780539 tempest-ServersAdminNegativeTestJSON-38780539-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:34.891109 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-6f252a93-db30-4002-a55d-c54ef62450b1 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:30:34.894803 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f252a93-db30-4002-a55d-c54ef62450b1 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:34.897707 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f252a93-db30-4002-a55d-c54ef62450b1 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:35.498504 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-6f252a93-db30-4002-a55d-c54ef62450b1 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Created allocations for migration 39c254d5-c58f-4803-b5fe-3f34428cba72 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:30:35.760249 n-d-816927-3 nova-conductor[89856]: DEBUG nova.scheduler.utils [None req-6f252a93-db30-4002-a55d-c54ef62450b1 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] [instance: 17715ec6-6d76-4280-84b0-11864a9440ac] Instance allocations successfully created on destination node 5b0d4dbc-4f26-40c5-adac-201db72ef7d4: {'allocations': {'5b0d4dbc-4f26-40c5-adac-201db72ef7d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89856) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 07:30:35.760615 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance [None req-6f252a93-db30-4002-a55d-c54ef62450b1 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lazy-loading 'resources' on Instance uuid 17715ec6-6d76-4280-84b0-11864a9440ac {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:30:35.766486 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance [None req-6f252a93-db30-4002-a55d-c54ef62450b1 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lazy-loading 'pci_requests' on Instance uuid 17715ec6-6d76-4280-84b0-11864a9440ac {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:30:36.151488 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.live_migrate [None req-6f252a93-db30-4002-a55d-c54ef62450b1 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] [instance: 17715ec6-6d76-4280-84b0-11864a9440ac] Start binding ports on destination host: n-h2-816927-3 {{(pid=89856) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 07:30:49.526831 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:49.549202 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:49.549594 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:49.596269 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:49.596660 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:49.597534 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:49.597960 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:49.614416 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:49.619219 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for user b84ce55416374bfbb71f613e163fd9f6 and project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:49.634835 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 3fcfb2d9-1b14-4c60-bea3-b228a125f152] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:49.635934 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:49.636457 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:49.651487 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 3fcfb2d9-1b14-4c60-bea3-b228a125f152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:49.654245 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:49.654782 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:49.692066 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:49.692877 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-76d4a2f2-1424-4efa-8a0d-c574aef98373 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:57.901847 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:57.967614 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:57.968114 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:58.080645 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:58.081314 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:58.082211 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:58.082605 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:58.101312 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Getting quotas for project e2ca8f351a8f4f09b3630d372bca3a46. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:58.107832 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Getting quotas for user 05423b39360244668b98971de0d7b5b2 and project e2ca8f351a8f4f09b3630d372bca3a46. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:58.124379 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] [instance: 2c8a068a-76a0-49b0-8ef7-6fcbaddae33f] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:58.125545 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:58.126258 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:58.139330 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] [instance: 2c8a068a-76a0-49b0-8ef7-6fcbaddae33f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:58.143215 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:58.143789 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:58.219840 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:58.220398 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d24da31b-9ecb-4afb-a219-ebb77af09571 tempest-ServersTestJSON-1650854644 tempest-ServersTestJSON-1650854644-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:59.387528 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:30:59.468331 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:59.469186 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:59.552914 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:59.553599 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:59.554552 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:59.555095 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:59.577309 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Getting quotas for project e8a823dfdf4841c7992572566bc0d958. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:30:59.582784 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Getting quotas for user dadf28eb154146f9b072b3f313386689 and project e8a823dfdf4841c7992572566bc0d958. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:30:59.595492 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: 993f6d8f-8ce4-4485-8684-5f2be00e3a51] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:30:59.596706 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:59.597230 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:59.606592 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: 993f6d8f-8ce4-4485-8684-5f2be00e3a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:30:59.608356 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:59.609195 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:30:59.657686 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:30:59.658396 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-84ad1ad5-bbaa-4bb1-a6f9-e43d6f9ebc8d tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:03.054061 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:03.111174 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:03.111575 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:03.207977 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:03.208609 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:03.210014 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:03.210807 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:03.229820 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Getting quotas for project 98319e01dbfe4598b01a8d44d8b5f07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:03.237230 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Getting quotas for user 7f79e2c43d194730b8a561ded7f55c70 and project 98319e01dbfe4598b01a8d44d8b5f07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:03.254656 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] [instance: 60ce40e2-29bd-4d53-918f-2b1668a75565] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:03.256170 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:03.256886 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:03.269187 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] [instance: 60ce40e2-29bd-4d53-918f-2b1668a75565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:03.272629 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:03.273971 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:03.325474 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:03.326283 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-593a91ff-8d4d-45c1-93d5-cea009698627 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:04.069649 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:04.112861 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:04.113373 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:04.173881 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:04.174471 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:04.175287 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:04.175870 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:04.196442 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Getting quotas for project 188801c96f1a4dab85517224b309cab9. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:04.201893 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Getting quotas for user c1f5f9645e844cb0866776c2cd55dd6a and project 188801c96f1a4dab85517224b309cab9. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:04.213851 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] [instance: 81825bc3-8e3d-4cab-86d2-77bc3d388d65] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:04.214945 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:04.215463 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:04.225853 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] [instance: 81825bc3-8e3d-4cab-86d2-77bc3d388d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:04.227674 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:04.228945 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:04.282662 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:04.283378 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-77b9968c-6af3-4a6a-9a78-48d56f968ced tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:14.953693 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:15.006239 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:15.006658 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:15.122505 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:15.122911 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:15.123708 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:15.124420 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:15.181655 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:15.191680 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for user b84ce55416374bfbb71f613e163fd9f6 and project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:15.213291 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 9dd49428-3af2-4742-8185-bd06a85cb990] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:15.221133 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:15.222049 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:15.239120 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 9dd49428-3af2-4742-8185-bd06a85cb990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:15.240664 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:15.241203 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:15.296184 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:15.296660 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ddad3243-ce85-44cb-8afd-aced9b8580dd tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:17.563095 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:17.608400 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:17.609329 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:17.703572 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:17.704105 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:17.704905 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:17.705380 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:17.760430 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Getting quotas for project df90946aeed34b0e8a52c6bda988d437. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:17.776649 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Getting quotas for user 47f45d3fcbf2407ab4bf6beec3b0ae43 and project df90946aeed34b0e8a52c6bda988d437. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:17.792051 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] [instance: 53a62216-564d-4351-b574-623a79c7f37f] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:17.793454 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:17.794679 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:17.807422 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] [instance: 53a62216-564d-4351-b574-623a79c7f37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:17.809640 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:17.810207 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:17.883590 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:17.884017 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-72a97ec6-ba50-407e-9885-b4eeba27926f tempest-ServerDiagnosticsNegativeTest-1805279172 tempest-ServerDiagnosticsNegativeTest-1805279172-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:20.220583 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:20.271669 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:20.273307 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:20.353768 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:20.354598 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:20.356179 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:20.356769 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:20.377938 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Getting quotas for project d2dfc997d6ea401fa322db74b076cbf6. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:20.384208 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Getting quotas for user 48eff7d22e5b4af7896f599acd282f8b and project d2dfc997d6ea401fa322db74b076cbf6. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:20.397256 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] [instance: 6f4a1c71-2daa-4232-95e7-0adffff168cb] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:20.398681 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:20.399714 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:20.409007 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] [instance: 6f4a1c71-2daa-4232-95e7-0adffff168cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:20.410615 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:20.411011 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:20.454404 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:20.454802 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8d0e1dd0-f678-4b12-bde2-286961f74ea3 tempest-VolumesAdminNegativeTest-1642892668 tempest-VolumesAdminNegativeTest-1642892668-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:20.849686 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b561b85d-cdcc-44af-b812-81f4eb7728e7 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:31:20.850993 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b561b85d-cdcc-44af-b812-81f4eb7728e7 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:20.851696 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b561b85d-cdcc-44af-b812-81f4eb7728e7 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:21.249934 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-b561b85d-cdcc-44af-b812-81f4eb7728e7 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: 993f6d8f-8ce4-4485-8684-5f2be00e3a51] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89857) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 07:31:21.705058 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-b561b85d-cdcc-44af-b812-81f4eb7728e7 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Created allocations for migration 702c55c0-5e1a-421c-920f-13ad91b567df on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:31:22.112165 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-b561b85d-cdcc-44af-b812-81f4eb7728e7 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: 993f6d8f-8ce4-4485-8684-5f2be00e3a51] Calling prep_resize with selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"5b0d4dbc-4f26-40c5-adac-201db72ef7d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5b0d4dbc-4f26-40c5-adac-201db72ef7d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=5b0d4dbc-4f26-40c5-adac-201db72ef7d4,limits=SchedulerLimits,nodename='n-h2-816927-3',service_host='n-h2-816927-3')] {{(pid=89857) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 07:31:33.507515 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:33.555679 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:33.556366 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:33.661326 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:33.662038 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:33.662916 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:33.667961 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:33.710100 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:33.715452 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Getting quotas for user b84ce55416374bfbb71f613e163fd9f6 and project b7b74494a659449abdd2e690d9c948c3. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:33.732385 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 5073c8b7-77a8-4c1a-854b-7684bd998171] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:33.739039 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:33.739616 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:33.752753 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] [instance: 5073c8b7-77a8-4c1a-854b-7684bd998171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:33.754559 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:33.755129 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:33.800808 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:33.801534 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-457bbbba-c2e2-49e1-a0a8-951df8e625b6 tempest-ServersOnMultiNodesTest-1351745626 tempest-ServersOnMultiNodesTest-1351745626-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:33.939882 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e05453f4-3f86-47e3-a65d-a6b898f87ace tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:31:33.940375 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e05453f4-3f86-47e3-a65d-a6b898f87ace tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:33.949671 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e05453f4-3f86-47e3-a65d-a6b898f87ace tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:34.515038 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-e05453f4-3f86-47e3-a65d-a6b898f87ace tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Created allocations for migration 9eee7f58-ea5c-4614-934e-81bb979e35c2 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:31:34.760810 n-d-816927-3 nova-conductor[89857]: DEBUG nova.scheduler.utils [None req-e05453f4-3f86-47e3-a65d-a6b898f87ace tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] [instance: 81825bc3-8e3d-4cab-86d2-77bc3d388d65] Instance allocations successfully created on destination node 5b0d4dbc-4f26-40c5-adac-201db72ef7d4: {'allocations': {'5b0d4dbc-4f26-40c5-adac-201db72ef7d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89857) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 07:31:34.761592 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-e05453f4-3f86-47e3-a65d-a6b898f87ace tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lazy-loading 'resources' on Instance uuid 81825bc3-8e3d-4cab-86d2-77bc3d388d65 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:31:34.768638 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-e05453f4-3f86-47e3-a65d-a6b898f87ace tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lazy-loading 'pci_requests' on Instance uuid 81825bc3-8e3d-4cab-86d2-77bc3d388d65 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:31:35.351641 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.live_migrate [None req-e05453f4-3f86-47e3-a65d-a6b898f87ace tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] [instance: 81825bc3-8e3d-4cab-86d2-77bc3d388d65] Start binding ports on destination host: n-h2-816927-3 {{(pid=89857) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 07:31:53.303060 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:53.326494 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:53.326959 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:53.378260 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:53.378939 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:53.379978 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:53.380460 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:53.402306 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Getting quotas for project fe0da6cd91ef4ff7b6225fcedeb0b9da. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:53.408143 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Getting quotas for user cbab368ad2094d728b324abfcfaaca0a and project fe0da6cd91ef4ff7b6225fcedeb0b9da. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:53.420662 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] [instance: 9d80149e-be02-4c8b-b574-65c1cc2c5f9e] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:53.421617 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:53.422041 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:53.430612 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] [instance: 9d80149e-be02-4c8b-b574-65c1cc2c5f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:53.432154 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:53.432597 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:53.473175 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:53.474159 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ebf152bb-72ed-4589-8bf9-b5e89f06e7a1 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.690945 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:54.745881 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:54.746298 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.801765 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:54.835326 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:54.836577 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.837510 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:54.837619 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:54.838216 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.838584 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.876710 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Getting quotas for project fe0da6cd91ef4ff7b6225fcedeb0b9da. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:54.887326 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Getting quotas for user cbab368ad2094d728b324abfcfaaca0a and project fe0da6cd91ef4ff7b6225fcedeb0b9da. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:54.903718 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] [instance: 2ec179bb-6f4c-4e6b-9e5b-3281afdc56d0] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:54.905158 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:54.906021 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.918948 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] [instance: 2ec179bb-6f4c-4e6b-9e5b-3281afdc56d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:54.927709 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:54.928392 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.957119 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:54.957491 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.959244 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:54.970123 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:54.999084 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Getting quotas for project 188801c96f1a4dab85517224b309cab9. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:55.003076 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:55.003607 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1afae045-e751-4e34-b479-711b7fffda59 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:55.010193 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Getting quotas for user c1f5f9645e844cb0866776c2cd55dd6a and project 188801c96f1a4dab85517224b309cab9. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:55.024792 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] [instance: 9ee66e15-4148-44ec-8a9a-1c427ba16273] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:55.026143 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:55.026789 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:55.038597 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] [instance: 9ee66e15-4148-44ec-8a9a-1c427ba16273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:55.039836 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:55.040238 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:55.084555 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:55.085495 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ff8e5b94-6fbb-4c7e-906f-afa521453c16 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:59.276213 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:31:59.303013 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:59.303659 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:59.370916 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:59.371232 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:59.372332 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:59.373198 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:59.399689 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Getting quotas for project 98319e01dbfe4598b01a8d44d8b5f07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:31:59.407154 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Getting quotas for user 7f79e2c43d194730b8a561ded7f55c70 and project 98319e01dbfe4598b01a8d44d8b5f07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:31:59.427934 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] [instance: 1d750808-33c8-4975-b360-2f6c33c0bad2] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:31:59.429081 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:59.429656 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:59.442683 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] [instance: 1d750808-33c8-4975-b360-2f6c33c0bad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:31:59.456188 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:59.466371 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:31:59.504299 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:31:59.504749 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cb6ec8e9-d3c7-44bf-8dfc-a5404f3f1e70 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:03.515789 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:32:03.538378 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:03.539071 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:03.593100 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:03.593509 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:03.595053 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:03.595521 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:03.630382 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Getting quotas for project e8a823dfdf4841c7992572566bc0d958. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:32:03.634950 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Getting quotas for user dadf28eb154146f9b072b3f313386689 and project e8a823dfdf4841c7992572566bc0d958. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:32:03.645805 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: e2430a62-62cb-4f02-a45b-bd0211256ee4] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:32:03.646858 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:03.647456 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:03.654385 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: e2430a62-62cb-4f02-a45b-bd0211256ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:32:03.655557 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:03.655953 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:03.690762 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:03.691234 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-04b5bdfb-8664-4abf-a724-8b7c9898a047 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:24.317767 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:32:24.385813 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:24.386282 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:24.500683 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:24.501084 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:24.501883 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:24.502269 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:24.538558 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Getting quotas for project fe0da6cd91ef4ff7b6225fcedeb0b9da. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:32:24.549609 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Getting quotas for user cbab368ad2094d728b324abfcfaaca0a and project fe0da6cd91ef4ff7b6225fcedeb0b9da. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:32:24.572964 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] [instance: f991182e-131a-4ff1-8b2a-97a3dabff340] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:32:24.574009 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:24.574496 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:24.587773 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] [instance: f991182e-131a-4ff1-8b2a-97a3dabff340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:32:24.589387 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:24.590140 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:24.683279 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:24.684009 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-992e6071-88ff-402d-bca4-d2f618c597e7 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:25.354420 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-99730d4d-b912-4af4-8cea-b34bf9314e71 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:32:25.359431 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-99730d4d-b912-4af4-8cea-b34bf9314e71 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:25.360023 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-99730d4d-b912-4af4-8cea-b34bf9314e71 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:25.688572 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-99730d4d-b912-4af4-8cea-b34bf9314e71 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: e2430a62-62cb-4f02-a45b-bd0211256ee4] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89856) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 07:32:26.348443 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-3ce1425b-1724-4250-9e31-48906cc6622c tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:32:26.350117 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-3ce1425b-1724-4250-9e31-48906cc6622c tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:26.350795 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-3ce1425b-1724-4250-9e31-48906cc6622c tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:26.581069 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-99730d4d-b912-4af4-8cea-b34bf9314e71 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Created allocations for migration 8f97cffd-fa33-4e8c-89c1-a18661870c05 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:32:27.064008 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-99730d4d-b912-4af4-8cea-b34bf9314e71 tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: e2430a62-62cb-4f02-a45b-bd0211256ee4] Calling prep_resize with selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"094cec38-2c25-455e-a298-721c1f99c6f8": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["094cec38-2c25-455e-a298-721c1f99c6f8"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=094cec38-2c25-455e-a298-721c1f99c6f8,limits=SchedulerLimits,nodename='n-h1-816927-3',service_host='n-h1-816927-3')] {{(pid=89856) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 07:32:27.228539 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-3ce1425b-1724-4250-9e31-48906cc6622c tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Created allocations for migration 9e162121-c0db-4fac-a73c-3cf940d5d758 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:32:27.394658 n-d-816927-3 nova-conductor[89857]: DEBUG nova.scheduler.utils [None req-3ce1425b-1724-4250-9e31-48906cc6622c tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] [instance: 9ee66e15-4148-44ec-8a9a-1c427ba16273] Instance allocations successfully created on destination node 5b0d4dbc-4f26-40c5-adac-201db72ef7d4: {'allocations': {'5b0d4dbc-4f26-40c5-adac-201db72ef7d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89857) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 07:32:27.395838 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-3ce1425b-1724-4250-9e31-48906cc6622c tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lazy-loading 'resources' on Instance uuid 9ee66e15-4148-44ec-8a9a-1c427ba16273 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:32:27.401099 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-3ce1425b-1724-4250-9e31-48906cc6622c tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9ee66e15-4148-44ec-8a9a-1c427ba16273 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:32:28.049579 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.live_migrate [None req-3ce1425b-1724-4250-9e31-48906cc6622c tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] [instance: 9ee66e15-4148-44ec-8a9a-1c427ba16273] Start binding ports on destination host: n-h2-816927-3 {{(pid=89857) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 07:32:31.645538 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:32:31.686519 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:31.687394 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:31.786616 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:31.787819 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:31.788847 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:31.789605 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:31.813321 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Getting quotas for project 7edcc310c84b4eab95508fbb8a5c981c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:32:31.820527 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Getting quotas for user 3939f1595aac4a4bb4288f7cc5e2691b and project 7edcc310c84b4eab95508fbb8a5c981c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:32:31.835539 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] [instance: 6f636c71-9fd1-4da7-a162-31be760fed8a] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:32:31.837108 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:31.837514 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:31.859406 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] [instance: 6f636c71-9fd1-4da7-a162-31be760fed8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:32:31.861860 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:31.862901 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:31.891986 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:31.892406 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:31.963485 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:31.963922 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cabbb13a-1c38-449e-bc97-993ad7e9f25d tempest-ServersWithSpecificFlavorTestJSON-223236188 tempest-ServersWithSpecificFlavorTestJSON-223236188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:36.092608 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:32:36.120192 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:36.120583 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:36.188422 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:36.190093 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:36.191017 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:36.191807 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:36.222625 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Getting quotas for project 707360a7d49a47ca95b39ce7fc02f0e7. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:32:36.228131 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Getting quotas for user 2c0d4320cc104aeeae7c2868d52adac1 and project 707360a7d49a47ca95b39ce7fc02f0e7. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:32:36.243453 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] [instance: 6b21c075-5107-4bf6-92d9-ee4d8d77a078] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:32:36.244397 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:36.244786 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:36.253596 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] [instance: 6b21c075-5107-4bf6-92d9-ee4d8d77a078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:32:36.255171 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:36.255733 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:32:36.291075 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:32:36.291491 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-db0852da-fe74-424a-bdb1-1471e5b93914 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309 tempest-FloatingIPsAssociationNegativeTestJSON-1134670309-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:08.276061 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-3425467d-bba7-49b9-be5d-9175eb04a442 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method rebuild_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:33:08.276728 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3425467d-bba7-49b9-be5d-9175eb04a442 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:08.277025 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3425467d-bba7-49b9-be5d-9175eb04a442 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:08.300912 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-3425467d-bba7-49b9-be5d-9175eb04a442 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] [instance: 9d80149e-be02-4c8b-b574-65c1cc2c5f9e] No migration record for the rebuild/evacuate request. {{(pid=89856) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 07:33:20.150356 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:33:20.189208 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:20.190499 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:20.260068 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:20.260765 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:20.262182 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:20.262569 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:20.287499 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Getting quotas for project 98319e01dbfe4598b01a8d44d8b5f07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:33:20.293837 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Getting quotas for user 7f79e2c43d194730b8a561ded7f55c70 and project 98319e01dbfe4598b01a8d44d8b5f07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:33:20.313504 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] [instance: ed43352b-7672-45ee-b6b4-fc6f40ede04c] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:33:20.314795 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:20.315346 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:20.327617 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] [instance: ed43352b-7672-45ee-b6b4-fc6f40ede04c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:33:20.331058 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:20.335690 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:20.392804 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:20.393522 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f4f-39ca-43b6-af38-bce9d99ed9a8 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:26.499992 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:33:26.586164 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:26.586744 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:26.699639 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:26.700742 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:26.702644 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:26.706627 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:26.765722 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Getting quotas for project e8a823dfdf4841c7992572566bc0d958. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:33:26.778449 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Getting quotas for user dadf28eb154146f9b072b3f313386689 and project e8a823dfdf4841c7992572566bc0d958. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:33:26.807323 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: 383daa57-df0d-4207-bd09-06ed23f510b3] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:33:26.811289 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:26.812701 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:26.827132 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] [instance: 383daa57-df0d-4207-bd09-06ed23f510b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:33:26.829556 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:26.834313 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:26.900469 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:26.901270 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ee4b1f1d-bf65-4ccd-b33d-920ad1bc535e tempest-MigrationsAdminTest-1793634620 tempest-MigrationsAdminTest-1793634620-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:35.794512 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:33:36.818944 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54878. Dec 16 07:33:40.225442 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:33:40.267049 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:40.268589 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:40.350403 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:40.351633 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:40.352508 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:40.352895 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:40.372570 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Getting quotas for project 188801c96f1a4dab85517224b309cab9. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:33:40.379029 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Getting quotas for user c1f5f9645e844cb0866776c2cd55dd6a and project 188801c96f1a4dab85517224b309cab9. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:33:40.392501 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] [instance: 355ad14e-d86f-4d39-9412-d8042e53aa36] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:33:40.393747 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:40.394341 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:40.405006 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] [instance: 355ad14e-d86f-4d39-9412-d8042e53aa36] block_device_mapping [BlockDeviceMapping(attachment_id=e0eeb6f8-2143-413c-a073-f2430a706731,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f3d64d80-3727-4c8c-9d8f-cf2efa28d8f3',volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:33:40.406530 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:40.406967 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:40.453977 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:40.454432 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4455210-cf3f-4a3e-8f2b-b93bd2eb09f7 tempest-LiveMigrationTest-1126617202 tempest-LiveMigrationTest-1126617202-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:42.572545 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d1d80732-131e-4a66-84c0-d83a10683963 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method rebuild_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:33:42.576218 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d1d80732-131e-4a66-84c0-d83a10683963 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:42.576890 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d1d80732-131e-4a66-84c0-d83a10683963 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:42.612535 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d1d80732-131e-4a66-84c0-d83a10683963 tempest-ServersAdminTestJSON-1498824422 tempest-ServersAdminTestJSON-1498824422-project] [instance: 9d80149e-be02-4c8b-b574-65c1cc2c5f9e] No migration record for the rebuild/evacuate request. {{(pid=89856) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 07:33:52.466735 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-634ffbd8-96ba-410e-ba23-9ba76949267b tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:33:52.467338 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-634ffbd8-96ba-410e-ba23-9ba76949267b tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:33:52.467982 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-634ffbd8-96ba-410e-ba23-9ba76949267b tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:33:53.034291 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-634ffbd8-96ba-410e-ba23-9ba76949267b tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] [instance: 383daa57-df0d-4207-bd09-06ed23f510b3] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89857) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 07:33:53.852900 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-634ffbd8-96ba-410e-ba23-9ba76949267b tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] Created allocations for migration 2c2795cf-57b9-485a-ad26-a9271c2fceb6 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:33:54.317374 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-634ffbd8-96ba-410e-ba23-9ba76949267b tempest-MigrationsAdminTest-1055788715 tempest-MigrationsAdminTest-1055788715-project-admin] [instance: 383daa57-df0d-4207-bd09-06ed23f510b3] Calling prep_resize with selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89857) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 07:34:01.800556 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:34:01.847080 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:01.847409 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:01.960940 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:01.961397 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:01.963300 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:01.963734 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:02.022584 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Getting quotas for project 8c52de0f7fff42278b777e7ae8d1a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:34:02.034092 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Getting quotas for user 3fff94af972144ff983fc78933b66ae4 and project 8c52de0f7fff42278b777e7ae8d1a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:34:02.065086 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] [instance: 19e0cf23-7907-43b9-be90-f9098d5bff71] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:34:02.065752 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:02.066435 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:02.078524 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] [instance: 19e0cf23-7907-43b9-be90-f9098d5bff71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:34:02.079790 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:02.080191 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:02.139506 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:02.140178 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f7a56306-a78f-448e-a214-c45adb304cbe tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:06.346574 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:34:06.377102 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:06.377842 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:06.431614 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:06.432939 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:06.434281 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:06.434870 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:06.455745 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Getting quotas for project 8c52de0f7fff42278b777e7ae8d1a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:34:06.461041 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Getting quotas for user 3fff94af972144ff983fc78933b66ae4 and project 8c52de0f7fff42278b777e7ae8d1a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:34:06.473263 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] [instance: 94b462da-0aaa-478e-a90f-38a49e59698f] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:34:06.474828 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:06.475386 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:06.486250 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] [instance: 94b462da-0aaa-478e-a90f-38a49e59698f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:34:06.489574 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:06.491976 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:06.558761 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:06.559933 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4615c8b1-39ef-45f8-be8a-5d32df0cc123 tempest-ServerRescueNegativeTestJSON-1044784822 tempest-ServerRescueNegativeTestJSON-1044784822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:14.273578 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-33c6a478-3465-4d34-b375-987868b978d8 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:34:14.275015 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-33c6a478-3465-4d34-b375-987868b978d8 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:14.275706 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-33c6a478-3465-4d34-b375-987868b978d8 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:15.054545 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-33c6a478-3465-4d34-b375-987868b978d8 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Created allocations for migration 1541954c-611b-4458-8eef-d07629d76841 on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:34:15.335555 n-d-816927-3 nova-conductor[89856]: DEBUG nova.scheduler.utils [None req-33c6a478-3465-4d34-b375-987868b978d8 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] [instance: 355ad14e-d86f-4d39-9412-d8042e53aa36] Instance allocations successfully created on destination node 094cec38-2c25-455e-a298-721c1f99c6f8: {'allocations': {'094cec38-2c25-455e-a298-721c1f99c6f8': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=89856) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 07:34:15.336940 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance [None req-33c6a478-3465-4d34-b375-987868b978d8 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lazy-loading 'resources' on Instance uuid 355ad14e-d86f-4d39-9412-d8042e53aa36 {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:34:15.344127 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance [None req-33c6a478-3465-4d34-b375-987868b978d8 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] Lazy-loading 'pci_requests' on Instance uuid 355ad14e-d86f-4d39-9412-d8042e53aa36 {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:34:16.126072 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.live_migrate [None req-33c6a478-3465-4d34-b375-987868b978d8 tempest-LiveMigrationTest-1116170382 tempest-LiveMigrationTest-1116170382-project-admin] [instance: 355ad14e-d86f-4d39-9412-d8042e53aa36] Start binding ports on destination host: n-h1-816927-3 {{(pid=89856) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 07:34:25.936840 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:34:25.978270 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:25.978270 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:26.032402 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:26.032786 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:26.033485 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:26.033896 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:26.063602 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Getting quotas for project 98319e01dbfe4598b01a8d44d8b5f07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:34:26.068178 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Getting quotas for user 7f79e2c43d194730b8a561ded7f55c70 and project 98319e01dbfe4598b01a8d44d8b5f07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:34:26.080188 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] [instance: 99d154f4-051b-4ce7-bbf2-64fcb847d705] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:34:26.081152 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:26.081538 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:26.095083 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] [instance: 99d154f4-051b-4ce7-bbf2-64fcb847d705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:34:26.096309 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:26.096789 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:26.147458 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:34:26.148137 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95e6bb14-68f0-4cb8-b427-de8eddbb8dc4 tempest-ImagesTestJSON-574748167 tempest-ImagesTestJSON-574748167-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:34:34.811952 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:34:35.838552 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55764. Dec 16 07:35:23.515683 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:35:23.558446 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:23.558825 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:23.691882 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:23.693675 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:23.694619 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:23.696573 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:23.718870 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Getting quotas for project 2250a5cd0c5d411dbaccdb2a06c7f72e. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:35:23.725562 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Getting quotas for user 14e965cca51848dda9e68cb83ada5ce2 and project 2250a5cd0c5d411dbaccdb2a06c7f72e. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:35:23.738148 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] [instance: e258914e-4b49-4bb7-a6d2-84ff7b7f0d7f] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:35:23.739912 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:23.740906 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:23.753376 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] [instance: e258914e-4b49-4bb7-a6d2-84ff7b7f0d7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:35:23.755193 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:23.755869 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:23.816605 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:23.817319 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0bfd11b2-2f8c-4e96-91dc-441137e3ff5f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:24.990731 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:35:25.069382 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:25.074172 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:25.221124 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:25.221617 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:25.223677 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:25.224181 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:25.268761 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Getting quotas for project 2250a5cd0c5d411dbaccdb2a06c7f72e. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:35:25.280070 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Getting quotas for user 14e965cca51848dda9e68cb83ada5ce2 and project 2250a5cd0c5d411dbaccdb2a06c7f72e. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:35:25.308979 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] [instance: 805b2499-18a0-4902-a77e-baad55ac86ca] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:35:25.310076 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:25.310578 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:25.336959 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] [instance: 805b2499-18a0-4902-a77e-baad55ac86ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:35:25.338645 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:25.339739 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:25.398780 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:25.399335 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d236aca-028e-4d20-88da-9d6fce82cd2f tempest-ListImageFiltersTestJSON-1587271034 tempest-ListImageFiltersTestJSON-1587271034-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:37.449203 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:35:37.487188 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:37.487965 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:37.599861 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:37.601620 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:37.602490 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:37.605286 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:37.646710 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Getting quotas for project b4d06d0a2f9b4eb4960c2ec24d5d8808. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:35:37.657902 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Getting quotas for user 60953a84f3714051b2d1b19c07c3fa27 and project b4d06d0a2f9b4eb4960c2ec24d5d8808. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:35:37.673176 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] [instance: 0ab83dad-ff07-4d94-97d6-a9cfa1c082eb] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:35:37.674936 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:37.675988 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:37.687487 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] [instance: 0ab83dad-ff07-4d94-97d6-a9cfa1c082eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:35:37.689106 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:37.690088 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:37.762033 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:37.762851 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-206f6b14-f335-48fc-87c1-6b3f6675f394 tempest-InstanceActionsTestJSON-1898263507 tempest-InstanceActionsTestJSON-1898263507-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:53.559343 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:35:53.620771 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:53.623629 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:53.781068 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:53.781706 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:53.782501 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:53.782894 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:53.837431 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Getting quotas for project 55f31d16b42646bdbdc49d64f8a55ea0. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:35:53.851107 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Getting quotas for user 71a1e77df85a40aca5dba57bff131271 and project 55f31d16b42646bdbdc49d64f8a55ea0. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:35:53.866578 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] [instance: b109104c-3b69-40b3-8e1f-a1553f9e0907] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:35:53.868209 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:53.868979 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:53.891603 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] [instance: b109104c-3b69-40b3-8e1f-a1553f9e0907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:35:53.893345 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:53.893918 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:35:53.984704 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:35:53.985410 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ef6f0b3-0284-46b3-a715-35b9a7f25a21 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:13.587927 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:36:13.639901 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:13.640303 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:13.752280 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:13.752953 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:13.754661 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:13.756383 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:13.784157 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Getting quotas for project 9affbeb4ee5c41aa9ba18b79d0c84938. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:36:13.789754 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Getting quotas for user 1a035f31361146a6bb6c329f3d706dc2 and project 9affbeb4ee5c41aa9ba18b79d0c84938. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:36:13.848514 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] [instance: 2841c1ec-f1e3-487b-a838-2bac73fed282] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:36:13.850510 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:13.852327 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:13.875440 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] [instance: 2841c1ec-f1e3-487b-a838-2bac73fed282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:36:13.877523 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:13.878241 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:13.968996 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:13.969651 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c24462db-b072-496a-a58a-f1d76e8b4c1e tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:14.002805 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:36:14.044533 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:14.045590 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:14.138138 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:14.138796 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:14.139703 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:14.140247 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:14.159652 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:36:14.164459 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for user 7f1e4d34c3d544e39379c2d7c3ea5c6a and project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:36:14.178173 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 167cc15d-9245-4674-ba8d-3c389d381470] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:36:14.179468 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:14.180024 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:14.189003 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 167cc15d-9245-4674-ba8d-3c389d381470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:36:14.192351 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:14.193359 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:14.267123 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:14.267777 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-74bff82f-3504-4767-8328-825020ddad94 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:28.327230 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:36:30.373222 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:36:30.395237 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:30.395652 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:30.445902 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:30.446486 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:30.447223 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:30.447614 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:30.462889 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Getting quotas for project 55f31d16b42646bdbdc49d64f8a55ea0. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:36:30.467375 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Getting quotas for user 71a1e77df85a40aca5dba57bff131271 and project 55f31d16b42646bdbdc49d64f8a55ea0. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:36:30.480689 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] [instance: aa2e519d-d956-450b-b432-f9e5ac009aaa] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:36:30.481630 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:30.482058 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:30.492815 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] [instance: aa2e519d-d956-450b-b432-f9e5ac009aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:36:30.494866 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:30.495490 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:30.542647 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:30.543212 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-76abb6fc-3e7e-4c0e-8709-032b77f737d2 tempest-FloatingIPsAssociationTestJSON-837514472 tempest-FloatingIPsAssociationTestJSON-837514472-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:36.815915 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:36:37.839537 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57968. Dec 16 07:36:43.832433 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e25b050f-1713-45f2-95b1-e3af0650c955 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:36:43.834246 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e25b050f-1713-45f2-95b1-e3af0650c955 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:43.836040 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e25b050f-1713-45f2-95b1-e3af0650c955 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:44.796234 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-e25b050f-1713-45f2-95b1-e3af0650c955 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Created allocations for migration 52d7dcf0-82fe-4b6f-a1bb-12986c228030 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:36:45.377597 n-d-816927-3 nova-conductor[89857]: DEBUG nova.scheduler.utils [None req-e25b050f-1713-45f2-95b1-e3af0650c955 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] [instance: 2841c1ec-f1e3-487b-a838-2bac73fed282] Instance allocations successfully created on destination node 5b0d4dbc-4f26-40c5-adac-201db72ef7d4: {'allocations': {'5b0d4dbc-4f26-40c5-adac-201db72ef7d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89857) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 07:36:45.378263 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-e25b050f-1713-45f2-95b1-e3af0650c955 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lazy-loading 'resources' on Instance uuid 2841c1ec-f1e3-487b-a838-2bac73fed282 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:36:45.385192 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-e25b050f-1713-45f2-95b1-e3af0650c955 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lazy-loading 'pci_requests' on Instance uuid 2841c1ec-f1e3-487b-a838-2bac73fed282 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:36:45.915143 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.live_migrate [None req-e25b050f-1713-45f2-95b1-e3af0650c955 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] [instance: 2841c1ec-f1e3-487b-a838-2bac73fed282] Start binding ports on destination host: n-h2-816927-3 {{(pid=89857) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 07:36:48.160807 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:36:48.265462 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:48.269753 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:48.397223 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:48.397523 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:48.406808 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:48.407206 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:48.452527 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Getting quotas for project 375e9c82a794488dbea93def2debb07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:36:48.458166 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Getting quotas for user e2682fb61e1b41caae642d1a9ab0164b and project 375e9c82a794488dbea93def2debb07b. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:36:48.470081 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] [instance: d35b0ea5-c4c4-4114-964a-8635d4ebac7d] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:36:48.471605 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:48.472761 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:48.485878 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] [instance: d35b0ea5-c4c4-4114-964a-8635d4ebac7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:36:48.487992 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:48.488581 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:48.538877 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:48.539617 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-6f46c5ca-625b-41a9-95b6-ab9f243febb8 tempest-ImagesNegativeTestJSON-1453565424 tempest-ImagesNegativeTestJSON-1453565424-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:51.503248 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Took 0.81 seconds to select destinations for 3 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:36:51.549809 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:51.550489 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:51.658812 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:51.659216 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:51.752522 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:51.753165 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:51.822815 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:51.823484 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:51.824389 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:51.825186 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:51.870543 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Getting quotas for project 8e07f6767ad947ddb1b598871b7aa844. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:36:51.876578 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Getting quotas for user 46473282a9204c9fae030fdb665a9923 and project 8e07f6767ad947ddb1b598871b7aa844. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:36:51.888139 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] [instance: ad7e2cd7-be55-4aaf-a718-2c645df49ecd] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:36:51.889335 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:51.889958 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:51.907375 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] [instance: ad7e2cd7-be55-4aaf-a718-2c645df49ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:36:51.908987 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:51.909547 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:52.014112 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:52.016798 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:52.053205 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] [instance: aff6e40b-c8ad-4f8c-b448-19b794cf2cf6] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:36:52.065871 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:52.068446 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:52.097449 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] [instance: aff6e40b-c8ad-4f8c-b448-19b794cf2cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:36:52.099422 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:52.100178 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:52.179214 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:52.179995 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:52.196266 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] [instance: cd3ed1e4-9f4d-41b6-8112-c53f524ae8cc] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:36:52.200773 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:52.201392 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:52.219886 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] [instance: cd3ed1e4-9f4d-41b6-8112-c53f524ae8cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:36:52.221769 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:52.222429 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:36:52.277165 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:36:52.277672 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5ae4c18f-1821-492e-b3bc-3069236f5a81 tempest-ListServersNegativeTestJSON-2138879438 tempest-ListServersNegativeTestJSON-2138879438-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:18.093931 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:37:18.146550 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:18.147122 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:18.236802 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:18.237472 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:18.238405 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:18.238973 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:18.256859 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Getting quotas for project 9affbeb4ee5c41aa9ba18b79d0c84938. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:37:18.263652 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Getting quotas for user 1a035f31361146a6bb6c329f3d706dc2 and project 9affbeb4ee5c41aa9ba18b79d0c84938. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:37:18.275879 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] [instance: ff26e839-57ac-4d45-bb33-943d43b421df] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:37:18.277084 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:18.277655 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:18.293815 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] [instance: ff26e839-57ac-4d45-bb33-943d43b421df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:37:18.295828 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:18.296278 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:18.361857 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:18.362386 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-971b3c40-1289-49a5-8d7b-d25148f5e479 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:39.460752 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:37:39.531433 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:39.538384 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:39.717263 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:39.718293 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:39.719376 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:39.721365 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:39.769541 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Getting quotas for project 5623330451b8418ca72639c30c78557e. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:37:39.788859 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Getting quotas for user e1810c62ec9741068385c5ff28cff0ec and project 5623330451b8418ca72639c30c78557e. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:37:39.822609 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] [instance: fdd72a1c-bddd-4d85-96e0-57c0289b1e43] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:37:39.825374 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:39.826880 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:39.844056 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] [instance: fdd72a1c-bddd-4d85-96e0-57c0289b1e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:37:39.846465 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:39.847053 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:39.898368 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:39.899168 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-52d6174b-30da-46fa-a743-e59dfb845ce8 tempest-ServerTagsTestJSON-1519172376 tempest-ServerTagsTestJSON-1519172376-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:47.564065 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:37:47.623320 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:47.624168 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:47.740315 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:47.742266 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:47.743531 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:47.746347 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:47.774253 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Getting quotas for project 7ba1ea174e2c4dd8b306fb69fd5fc12d. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:37:47.780035 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Getting quotas for user 05ef2b4d0ade497192010dd3b2e9f42f and project 7ba1ea174e2c4dd8b306fb69fd5fc12d. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:37:47.794395 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] [instance: 25ea04f2-ec0d-4627-bc4e-418300964ef1] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:37:47.795512 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:47.796295 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:47.807577 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] [instance: 25ea04f2-ec0d-4627-bc4e-418300964ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:37:47.809636 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:47.809831 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:47.857375 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:47.858785 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0698d854-b0ab-49d6-aa41-dc8c8bff29ac tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:57.383758 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-491e1cf3-e04e-4156-9f5c-9dd265def413 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:37:57.384333 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-491e1cf3-e04e-4156-9f5c-9dd265def413 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:37:57.384538 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-491e1cf3-e04e-4156-9f5c-9dd265def413 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:37:57.993752 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-491e1cf3-e04e-4156-9f5c-9dd265def413 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Created allocations for migration 5f7b6f27-fdf9-40e4-9322-393ddcc4fd9a on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:37:58.174910 n-d-816927-3 nova-conductor[89857]: DEBUG nova.scheduler.utils [None req-491e1cf3-e04e-4156-9f5c-9dd265def413 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] [instance: ff26e839-57ac-4d45-bb33-943d43b421df] Instance allocations successfully created on destination node 5b0d4dbc-4f26-40c5-adac-201db72ef7d4: {'allocations': {'5b0d4dbc-4f26-40c5-adac-201db72ef7d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89857) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 07:37:58.175332 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-491e1cf3-e04e-4156-9f5c-9dd265def413 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lazy-loading 'resources' on Instance uuid ff26e839-57ac-4d45-bb33-943d43b421df {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:37:58.180212 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-491e1cf3-e04e-4156-9f5c-9dd265def413 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lazy-loading 'pci_requests' on Instance uuid ff26e839-57ac-4d45-bb33-943d43b421df {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:37:58.672178 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.live_migrate [None req-491e1cf3-e04e-4156-9f5c-9dd265def413 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] [instance: ff26e839-57ac-4d45-bb33-943d43b421df] Start binding ports on destination host: n-h2-816927-3 {{(pid=89857) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 07:38:13.432600 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:38:13.457413 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:13.458067 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:13.518547 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:13.518912 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:13.519575 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:13.519958 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:13.537678 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Getting quotas for project ac6da408e16e46a09a5ffaee07078f94. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:38:13.542384 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Getting quotas for user 648daf352cb54ccebbcf362204f65304 and project ac6da408e16e46a09a5ffaee07078f94. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:38:13.554085 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] [instance: 857afa6b-406a-481b-8e21-26a6b07cfd97] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:38:13.555091 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:13.555493 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:13.562479 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] [instance: 857afa6b-406a-481b-8e21-26a6b07cfd97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:38:13.563862 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:13.564281 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:13.595687 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:13.596370 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c76c7f6b-e9fc-4014-a624-531012fdb224 tempest-ServerAddressesNegativeTestJSON-597946746 tempest-ServerAddressesNegativeTestJSON-597946746-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:23.438672 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:38:23.470788 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:23.471317 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:23.535455 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:23.536331 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:23.538100 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:23.539867 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:23.573341 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Getting quotas for project 9affbeb4ee5c41aa9ba18b79d0c84938. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:38:23.580464 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Getting quotas for user 1a035f31361146a6bb6c329f3d706dc2 and project 9affbeb4ee5c41aa9ba18b79d0c84938. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:38:23.593410 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] [instance: 2a8068f7-2e2f-41cc-bc34-390ab407f2f5] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:38:23.595356 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:23.595776 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:23.616934 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] [instance: 2a8068f7-2e2f-41cc-bc34-390ab407f2f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:38:23.620690 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:23.621107 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:23.672040 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:23.672640 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-61c4ca95-3637-4a28-83ec-f1baf6b41be7 tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:38.790083 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:38:38.841754 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:38.843426 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:38.956378 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:38.956781 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:38.958456 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:38.958743 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:39.013134 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Getting quotas for project 3d2958b4f99b4f5f8618b0500f09c142. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:38:39.018469 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Getting quotas for user 1acb38d0626e4b07a8c691118b62227b and project 3d2958b4f99b4f5f8618b0500f09c142. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:38:39.040031 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] [instance: a19072a2-7b95-4a33-ab7a-298f974a241d] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:38:39.045170 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:39.046249 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:39.070788 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] [instance: a19072a2-7b95-4a33-ab7a-298f974a241d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:38:39.072789 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:39.073285 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:39.126341 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:39.126918 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-4bc27ced-1d3f-4ebd-bdb6-bd88eed93bd7 tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:48.303452 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Took 1.21 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:38:48.356730 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:48.357119 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:48.457018 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:48.457584 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:48.465340 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:48.465715 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:48.504406 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Getting quotas for project 7ba1ea174e2c4dd8b306fb69fd5fc12d. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:38:48.509306 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Getting quotas for user 05ef2b4d0ade497192010dd3b2e9f42f and project 7ba1ea174e2c4dd8b306fb69fd5fc12d. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:38:48.538928 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] [instance: 90a8bd06-e048-47c4-9acc-f0c2c401299c] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:38:48.539881 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:48.540284 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:48.548739 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] [instance: 90a8bd06-e048-47c4-9acc-f0c2c401299c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:38:48.549986 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:48.550370 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:48.605907 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:48.607132 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-81084b72-bd6d-4ea4-bc82-517e307f08db tempest-SecurityGroupsTestJSON-1174119434 tempest-SecurityGroupsTestJSON-1174119434-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:50.471835 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-71269593-226e-4623-b13d-14bd5a4dc08e tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method rebuild_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:38:50.472351 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-71269593-226e-4623-b13d-14bd5a4dc08e tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:50.472689 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-71269593-226e-4623-b13d-14bd5a4dc08e tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:50.507116 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-71269593-226e-4623-b13d-14bd5a4dc08e tempest-ServerShowV254Test-1620549427 tempest-ServerShowV254Test-1620549427-project] [instance: a19072a2-7b95-4a33-ab7a-298f974a241d] No migration record for the rebuild/evacuate request. {{(pid=89856) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 07:38:51.473267 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:38:51.505363 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:51.506655 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:51.615546 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:51.615954 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:51.616686 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:51.617084 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:51.652561 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Getting quotas for project 0890403d46a9480f83e590121aa44e6f. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:38:51.663210 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Getting quotas for user b8d9e9397fad4dad9724b821fd431c08 and project 0890403d46a9480f83e590121aa44e6f. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:38:51.682527 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] [instance: 1db55fe3-0220-4c76-bd38-05de4af1202e] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:38:51.683998 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:51.684410 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:51.697933 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] [instance: 1db55fe3-0220-4c76-bd38-05de4af1202e] block_device_mapping [BlockDeviceMapping(attachment_id=a1763b08-08d0-42ea-9439-dcc957e1c7ab,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e73aba0e-ea54-4eb8-a239-0b513678f14d',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=f504991a-4bdf-4ee9-96f3-beef84141799,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='bb88cb4c-16f9-4b09-889e-4876c9e2bf32',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=20f3d72d-4034-4fd2-b72b-bac37b00fcc7,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d517ed02-9b74-4460-8d23-33fdce0bde7f',volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:38:51.703345 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:51.705394 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:51.723352 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:51.723855 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:51.745252 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:51.745724 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:51.805491 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:51.805959 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e4a-6861-4732-a4e7-ead5dff857bf tempest-TaggedBootDevicesTest_v242-707909451 tempest-TaggedBootDevicesTest_v242-707909451-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:57.149128 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:38:57.249329 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:57.249329 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:57.363198 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:57.366288 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:57.367471 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:57.369069 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:57.442728 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Getting quotas for project 05a513c1139b4bcc929ec30e3e906eae. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:38:57.461950 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Getting quotas for user 8627c798d89c4f25ad5ccf74ff6558fd and project 05a513c1139b4bcc929ec30e3e906eae. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:38:57.486742 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] [instance: 98e517c6-d82e-4b2f-acab-2dc8ef3e5e8a] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:38:57.487696 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:57.488087 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:57.515685 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] [instance: 98e517c6-d82e-4b2f-acab-2dc8ef3e5e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:38:57.517483 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:57.517989 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:38:57.570866 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:38:57.571381 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ad44510e-2caa-45e3-8d58-56a4853d6f54 tempest-ServerPasswordTestJSON-1465264637 tempest-ServerPasswordTestJSON-1465264637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:10.638287 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-536ef1ba-7b35-4e50-afa2-ee6603d8cb14 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:39:10.639000 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-536ef1ba-7b35-4e50-afa2-ee6603d8cb14 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:10.639191 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-536ef1ba-7b35-4e50-afa2-ee6603d8cb14 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:11.362959 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-536ef1ba-7b35-4e50-afa2-ee6603d8cb14 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Created allocations for migration 93ca3e9d-a3df-4595-be8f-481a43780faf on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:39:11.568396 n-d-816927-3 nova-conductor[89857]: DEBUG nova.scheduler.utils [None req-536ef1ba-7b35-4e50-afa2-ee6603d8cb14 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] [instance: 2a8068f7-2e2f-41cc-bc34-390ab407f2f5] Instance allocations successfully created on destination node 5b0d4dbc-4f26-40c5-adac-201db72ef7d4: {'allocations': {'5b0d4dbc-4f26-40c5-adac-201db72ef7d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89857) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 07:39:11.569061 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-536ef1ba-7b35-4e50-afa2-ee6603d8cb14 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lazy-loading 'resources' on Instance uuid 2a8068f7-2e2f-41cc-bc34-390ab407f2f5 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:39:11.575001 n-d-816927-3 nova-conductor[89857]: DEBUG nova.objects.instance [None req-536ef1ba-7b35-4e50-afa2-ee6603d8cb14 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lazy-loading 'pci_requests' on Instance uuid 2a8068f7-2e2f-41cc-bc34-390ab407f2f5 {{(pid=89857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:39:11.957866 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.live_migrate [None req-536ef1ba-7b35-4e50-afa2-ee6603d8cb14 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] [instance: 2a8068f7-2e2f-41cc-bc34-390ab407f2f5] Start binding ports on destination host: n-h2-816927-3 {{(pid=89857) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 07:39:13.349474 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:39:13.395953 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:13.397016 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:13.549366 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:13.549755 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:13.564619 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:13.565023 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:13.628051 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Getting quotas for project f8c93015831d4af79ef3675c80cc9063. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:39:13.644916 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Getting quotas for user 1f24f9841c7343188b2594df9c7cc511 and project f8c93015831d4af79ef3675c80cc9063. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:39:13.673795 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] [instance: 260fa75b-a56b-4f2c-8df0-5893756b4f3e] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:39:13.675482 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:13.676232 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:13.687837 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] [instance: 260fa75b-a56b-4f2c-8df0-5893756b4f3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:39:13.689587 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:13.690374 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:13.759582 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:13.760468 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-efbba77d-2623-42e6-935e-01b1e0ac176f tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:37.838002 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:39:38.886641 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32888. Dec 16 07:39:42.511626 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:39:42.570780 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:42.573056 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:42.679812 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:42.682450 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:42.683185 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:42.683569 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:42.727115 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Getting quotas for project 00c14f351f3d4f04997d09bddd68a344. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:39:42.732754 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Getting quotas for user 66fb10b5c47b4408b457e50ac2bdeadb and project 00c14f351f3d4f04997d09bddd68a344. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:39:42.744796 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] [instance: 68b9b56f-78e6-4af5-9f01-d56f536c3fd3] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:39:42.745809 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:42.746331 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:42.761994 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] [instance: 68b9b56f-78e6-4af5-9f01-d56f536c3fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:39:42.764383 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:42.765031 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:42.856464 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:42.856927 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-5019a11f-3a44-417f-b985-6ee0b89fe16a tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:45.680219 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:39:45.745198 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:45.745891 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:45.849590 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:45.850310 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:45.851221 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:45.853959 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:45.889000 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Getting quotas for project 00c14f351f3d4f04997d09bddd68a344. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:39:45.894245 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Getting quotas for user 66fb10b5c47b4408b457e50ac2bdeadb and project 00c14f351f3d4f04997d09bddd68a344. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:39:45.905582 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] [instance: e0a40996-ffa1-4dbf-9b25-6208006a3073] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:39:45.906800 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:45.907351 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:45.919525 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] [instance: e0a40996-ffa1-4dbf-9b25-6208006a3073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:39:45.921191 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:45.921586 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:45.979782 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:45.980191 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb114033-dc7a-4eb9-b1e6-0212f3a4d645 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:51.413880 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-15110573-8024-4047-90ca-3ed7b858cb84 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method rebuild_instance {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:39:51.415997 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-15110573-8024-4047-90ca-3ed7b858cb84 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:51.417148 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-15110573-8024-4047-90ca-3ed7b858cb84 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:51.452644 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-15110573-8024-4047-90ca-3ed7b858cb84 tempest-ServerShowV247Test-2087798139 tempest-ServerShowV247Test-2087798139-project] [instance: e0a40996-ffa1-4dbf-9b25-6208006a3073] No migration record for the rebuild/evacuate request. {{(pid=89857) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 07:39:54.646438 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:39:54.710352 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:54.710868 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:54.812308 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:54.813008 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:54.814167 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:54.814763 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:54.842045 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Getting quotas for project 3e7c0578e2e247ff974df77132df329b. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:39:54.848453 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Getting quotas for user 0ddf5b392e1549eb87cd32339ef5977d and project 3e7c0578e2e247ff974df77132df329b. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:39:54.865423 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] [instance: 612b4b77-6795-415a-bc7d-b29fec568a8d] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:39:54.866799 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:54.867455 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:54.896522 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] [instance: 612b4b77-6795-415a-bc7d-b29fec568a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:39:54.898544 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:54.899136 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:39:54.959248 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:39:54.959638 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ffa890a6-ffba-4601-a2bd-f8ad20c887f1 tempest-ServersTestManualDisk-850617248 tempest-ServersTestManualDisk-850617248-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:18.886206 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:40:18.926786 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:18.927657 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:19.026003 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:19.026665 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:19.034136 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:19.035678 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:19.062401 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Getting quotas for project f8c93015831d4af79ef3675c80cc9063. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:40:19.068163 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Getting quotas for user 1f24f9841c7343188b2594df9c7cc511 and project f8c93015831d4af79ef3675c80cc9063. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:40:19.086110 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] [instance: 8d8b6553-b8e1-4f1a-937f-191d35acad0a] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:40:19.087450 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:19.088051 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:19.100543 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] [instance: 8d8b6553-b8e1-4f1a-937f-191d35acad0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:40:19.102583 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:19.103025 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:19.143594 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:19.144593 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c73dd82b-0bdd-4016-a3ea-9b0fc4171717 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:23.741485 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:40:23.782256 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:23.785280 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:23.872983 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:23.874732 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:23.876517 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:23.877922 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:23.921270 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Getting quotas for project 9affbeb4ee5c41aa9ba18b79d0c84938. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:40:23.932208 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Getting quotas for user 1a035f31361146a6bb6c329f3d706dc2 and project 9affbeb4ee5c41aa9ba18b79d0c84938. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:40:23.958232 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] [instance: 288963a9-1d14-4856-bc21-d90c8262b072] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:40:23.964055 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:23.964764 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:23.979711 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] [instance: 288963a9-1d14-4856-bc21-d90c8262b072] block_device_mapping [BlockDeviceMapping(attachment_id=04df68cb-24f1-4928-a695-97270e9e67ce,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea5522c6-3ce0-4269-b797-6ebbbb8757fa',volume_size=1,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:40:23.981459 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:23.982237 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:24.040638 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:24.041418 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-975c08fe-4beb-431d-be15-909dd5caa8ad tempest-LiveAutoBlockMigrationV225Test-1153182637 tempest-LiveAutoBlockMigrationV225Test-1153182637-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:26.836783 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:40:26.887351 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:26.889754 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:26.985299 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:26.985808 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:26.986569 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:26.986961 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:27.018974 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:40:27.031340 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for user 7f1e4d34c3d544e39379c2d7c3ea5c6a and project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:40:27.080238 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 8a018ae8-d06b-45f7-9c07-92fa4db3d2eb] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:40:27.080238 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:27.080238 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:27.085608 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 8a018ae8-d06b-45f7-9c07-92fa4db3d2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:40:27.087075 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:27.087631 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:27.147598 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:27.148035 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a307cf09-449a-468b-a457-cc54c560cc62 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:27.855768 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:40:27.922506 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:27.922808 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:28.063082 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:28.064389 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:28.065240 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:28.067852 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:28.127583 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:40:28.134236 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for user efd53baf3caf4c98b3f77b8c7d3a5cd2 and project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:40:28.160599 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: 978f5a85-3c7e-407b-9777-f75daf309f77] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:40:28.161557 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:28.169213 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:28.189329 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: 978f5a85-3c7e-407b-9777-f75daf309f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:40:28.190576 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:28.191253 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:28.246348 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:28.247267 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0ddbdec2-edf6-4f99-bce2-dd367e90c3b6 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:51.688980 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:40:51.739947 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:51.742417 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:51.839670 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:51.842687 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:51.843856 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:51.844393 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:51.883886 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Getting quotas for project f8c93015831d4af79ef3675c80cc9063. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:40:51.897579 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Getting quotas for user 1f24f9841c7343188b2594df9c7cc511 and project f8c93015831d4af79ef3675c80cc9063. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:40:51.928896 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] [instance: b48e0b4d-f332-458a-8e4b-fc58f7e3caf0] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:40:51.930253 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:51.930653 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:51.945999 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] [instance: b48e0b4d-f332-458a-8e4b-fc58f7e3caf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:40:51.947312 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:51.948328 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:52.020984 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:52.021401 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-f9761e7a-77e6-46cc-b2f0-cef122bf39e8 tempest-ImagesOneServerNegativeTestJSON-1514241831 tempest-ImagesOneServerNegativeTestJSON-1514241831-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:54.434404 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ae8c9144-830d-4cf4-8ecb-50c36736d674 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:40:54.434404 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ae8c9144-830d-4cf4-8ecb-50c36736d674 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:54.434404 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ae8c9144-830d-4cf4-8ecb-50c36736d674 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:55.161751 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-ae8c9144-830d-4cf4-8ecb-50c36736d674 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Created allocations for migration 998fca8d-649d-4063-90dd-45f4e5e443f3 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 07:40:55.326075 n-d-816927-3 nova-conductor[89856]: DEBUG nova.scheduler.utils [None req-ae8c9144-830d-4cf4-8ecb-50c36736d674 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] [instance: 288963a9-1d14-4856-bc21-d90c8262b072] Instance allocations successfully created on destination node 5b0d4dbc-4f26-40c5-adac-201db72ef7d4: {'allocations': {'5b0d4dbc-4f26-40c5-adac-201db72ef7d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=89856) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 07:40:55.326522 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance [None req-ae8c9144-830d-4cf4-8ecb-50c36736d674 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lazy-loading 'resources' on Instance uuid 288963a9-1d14-4856-bc21-d90c8262b072 {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:40:55.332399 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance [None req-ae8c9144-830d-4cf4-8ecb-50c36736d674 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] Lazy-loading 'pci_requests' on Instance uuid 288963a9-1d14-4856-bc21-d90c8262b072 {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 07:40:55.697265 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.live_migrate [None req-ae8c9144-830d-4cf4-8ecb-50c36736d674 tempest-LiveAutoBlockMigrationV225Test-2132541821 tempest-LiveAutoBlockMigrationV225Test-2132541821-project-admin] [instance: 288963a9-1d14-4856-bc21-d90c8262b072] Start binding ports on destination host: n-h2-816927-3 {{(pid=89856) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 07:40:56.164378 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:40:56.192193 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:56.192193 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:56.273793 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:56.276281 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:56.278575 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:56.279144 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:56.308013 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:40:56.318047 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for user efd53baf3caf4c98b3f77b8c7d3a5cd2 and project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:40:56.339455 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: ec43233c-77bd-4594-94bb-128b2b6a15c5] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:40:56.341333 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:56.345016 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:56.357632 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: ec43233c-77bd-4594-94bb-128b2b6a15c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:40:56.359596 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:56.360160 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:40:56.406569 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:40:56.407719 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4ec3d3ec-0999-4c3c-b4ab-6343c40b95c9 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:26.145818 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:41:26.250236 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:26.250823 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:26.378355 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:26.378786 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:26.379571 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:26.379987 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:26.401463 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:41:26.414951 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for user 7f1e4d34c3d544e39379c2d7c3ea5c6a and project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:41:26.445056 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 212624a5-3e0a-47a5-9aed-07a05a9bc48e] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:41:26.456652 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:26.457171 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:26.473932 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 212624a5-3e0a-47a5-9aed-07a05a9bc48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:41:26.475371 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:26.475782 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:26.532148 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:26.532550 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-14c62f0c-fc14-4cb5-bdd1-661bc57f5a32 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:28.353953 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:41:35.839230 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:41:36.867758 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 35850. Dec 16 07:41:43.440405 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:41:43.461530 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: bd361fa3-6d26-46a3-a988-1bf5f761cb18] While scheduling instance, the build request was already deleted. {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1563}} Dec 16 07:41:43.650153 n-d-816927-3 nova-conductor[89857]: INFO nova.scheduler.client.report [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Deleted allocation for instance bd361fa3-6d26-46a3-a988-1bf5f761cb18 Dec 16 07:41:43.689907 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:43.690548 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:43.691392 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:43.691781 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:43.751664 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:41:43.768384 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-814b0b17-a621-4ebf-b7ba-5aaaa18bef92 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for user efd53baf3caf4c98b3f77b8c7d3a5cd2 and project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:41:47.174531 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:41:47.251050 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:47.251515 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:47.343891 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:47.348580 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:47.349854 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:47.350254 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:47.390784 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:41:47.402862 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for user efd53baf3caf4c98b3f77b8c7d3a5cd2 and project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:41:47.435744 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: 7e43e43a-7fcc-4c65-8113-71fa57999922] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:41:47.436847 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:47.438279 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:47.457167 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: 7e43e43a-7fcc-4c65-8113-71fa57999922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:41:47.462239 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:47.463764 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:41:47.542745 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:41:47.543169 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19d03fa3-e2f0-4cc5-9df4-d34d0d70246e tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:18.479001 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:42:18.531902 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:18.539522 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:18.644569 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:18.645633 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:18.646386 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:18.646774 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:18.698866 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:42:18.710813 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for user efd53baf3caf4c98b3f77b8c7d3a5cd2 and project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:42:18.731760 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: 2645bd3d-6560-4aee-b464-94aeec118e46] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:42:18.732766 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:18.733167 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:18.751224 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: 2645bd3d-6560-4aee-b464-94aeec118e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:42:18.753500 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:18.755280 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:18.808934 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:18.810188 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-231ebfc1-9bb4-45aa-b2d4-0c94ee5365be tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:51.682168 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:42:51.715957 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:51.716360 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:51.793851 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:51.794173 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:51.795401 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:51.795941 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:51.814048 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Getting quotas for project 56b37181acdf41b281d3e44bcbf39a2c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:42:51.818994 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Getting quotas for user 6d7b17a0eaf14d1b8b6d53e5275c2dfb and project 56b37181acdf41b281d3e44bcbf39a2c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:42:51.832698 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] [instance: b0af81a0-984c-403d-8962-eeb55d1b62ee] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:42:51.834176 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:51.834840 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:51.854927 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] [instance: b0af81a0-984c-403d-8962-eeb55d1b62ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:42:51.856474 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:51.857146 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:42:51.914819 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:42:51.915770 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ce76b72e-a287-47fd-ae7b-930c2a9ab56b tempest-InstanceActionsV221TestJSON-448594822 tempest-InstanceActionsV221TestJSON-448594822-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:09.066170 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:43:09.166205 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:09.169544 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:09.307461 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:09.308038 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:09.308861 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:09.309350 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:09.370765 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Getting quotas for project 5dcf87e6de2246038b75f7e31e5ab118. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:43:09.382182 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Getting quotas for user 4cb2eb4df90e426c939cb95630397273 and project 5dcf87e6de2246038b75f7e31e5ab118. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:43:09.412886 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] [instance: 292f6db7-a2f2-4fa1-b9e4-82876cea3430] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:43:09.417167 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:09.417605 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:09.437709 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] [instance: 292f6db7-a2f2-4fa1-b9e4-82876cea3430] block_device_mapping [BlockDeviceMapping(attachment_id=9261622e-11cb-42f4-8463-4350dbad8c52,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b54b51c7-f551-4e1c-8ac4-4acfde91c156',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=985a18d0-dad6-4fbc-b08e-d7d2edec033f,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7b3b0f0f-e8ff-4482-ad7d-887362685bc1',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=bdd22900-74d6-4ecc-ae32-abd5f3c5211e,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abb3bbfe-1746-4e46-bfdb-ad2eddb8da0d',volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:43:09.439688 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:09.440139 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:09.456407 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:09.456936 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:09.471559 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:09.472474 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:09.516773 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:09.517226 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbd9-ba2f-40b3-93f9-8e89d6707ee9 tempest-TaggedBootDevicesTest-1382203492 tempest-TaggedBootDevicesTest-1382203492-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:11.498304 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:43:36.786855 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:43:36.839363 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:36.840503 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:37.084134 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:37.084635 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:37.085484 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:37.086213 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:37.111046 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Getting quotas for project 9fbf1e5878404e35aff0911e7a3f62b4. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:43:37.133195 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Getting quotas for user 87a1dbb450a9443faba66fc9ace01ad8 and project 9fbf1e5878404e35aff0911e7a3f62b4. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:43:37.175371 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] [instance: 63f0217a-9fd8-426d-993c-ccffe51b001a] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:43:37.176398 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:37.178044 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:37.194494 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] [instance: 63f0217a-9fd8-426d-993c-ccffe51b001a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d743330e-39c8-4602-a01e-b38ec42f8bf3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:43:37.196145 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:37.197046 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:37.275707 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:37.276035 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a310be3d-3a0f-4cf6-9aa2-8fbd2753f1b1 tempest-AttachSCSIVolumeTestJSON-1123534170 tempest-AttachSCSIVolumeTestJSON-1123534170-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:38.868886 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:43:39.904495 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38576. Dec 16 07:43:40.116261 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:43:40.212918 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:40.213700 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:40.341640 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:40.347052 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:40.349270 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:40.350537 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:40.434438 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Getting quotas for project 28ac151403604e959fba4c5c9e98202a. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:43:40.446446 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Getting quotas for user 8434f35e1c27450884bcaca65ba10361 and project 28ac151403604e959fba4c5c9e98202a. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:43:40.497142 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] [instance: c34f9b84-4ee0-4ad3-8bab-335f2a90a07b] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:43:40.498627 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:40.499262 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:40.512505 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] [instance: c34f9b84-4ee0-4ad3-8bab-335f2a90a07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:43:40.514820 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:40.518218 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:40.603976 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:40.604687 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9d2da4c8-b8a2-430d-87e6-20f5b2287c46 tempest-InstanceActionsNegativeTestJSON-748798910 tempest-InstanceActionsNegativeTestJSON-748798910-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:52.228524 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:43:52.265915 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:52.266592 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:52.364933 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:52.365665 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:52.366693 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:52.367274 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:52.387393 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:43:52.393161 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for user 7f1e4d34c3d544e39379c2d7c3ea5c6a and project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:43:52.408942 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 5822f2a9-bc2d-491a-a177-50237edb95f8] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:43:52.409992 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:52.410584 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:52.419350 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 5822f2a9-bc2d-491a-a177-50237edb95f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:43:52.421460 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:52.422205 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:52.474469 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:52.474982 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-7d8ab445-3a91-48d3-b83e-068a0f2c87bf tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:58.330997 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:43:58.359503 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:58.360009 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:58.435398 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:58.436001 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:58.437162 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:58.437649 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:58.468361 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:43:58.477965 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for user efd53baf3caf4c98b3f77b8c7d3a5cd2 and project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:43:58.498359 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: d33442d8-9364-4397-ae46-7e8e2e0decc5] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:43:58.499803 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:58.500453 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:58.510655 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: d33442d8-9364-4397-ae46-7e8e2e0decc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:43:58.512215 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:58.512805 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:43:58.555654 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:43:58.556505 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-870de6b9-4f74-4e92-905d-e9e6dfba1f16 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:22.960459 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:44:22.986586 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:22.987791 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:23.078368 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:23.079389 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:23.081385 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:23.083814 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:23.111826 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:44:23.117742 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Getting quotas for user 7f1e4d34c3d544e39379c2d7c3ea5c6a and project 9655059d0925408ea17e0b040b01ce13. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:44:23.179671 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 51055f88-926b-496d-96a6-d5c0ec1a2cae] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:44:23.180654 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:23.181072 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:23.208284 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] [instance: 51055f88-926b-496d-96a6-d5c0ec1a2cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:44:23.218216 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:23.219317 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:23.338521 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:23.340678 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e24e12b0-3080-44fc-9577-f712dee480a9 tempest-ServerActionsTestJSON-1980018110 tempest-ServerActionsTestJSON-1980018110-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:32.711047 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Took 0.56 seconds to select destinations for 2 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:44:32.750690 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:32.751392 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:32.854429 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:32.855766 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:32.912023 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:32.912859 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:32.913868 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:32.914527 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:32.938603 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Getting quotas for project c99327fc256f454ba5a689a2005c37fe. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:44:32.944420 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Getting quotas for user 5d355de174a94d31bdee817011fac050 and project c99327fc256f454ba5a689a2005c37fe. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:44:32.959026 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] [instance: ba77d78b-9ff1-4db3-8e30-92a83150faee] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:44:32.961434 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:32.962086 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:32.971746 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] [instance: ba77d78b-9ff1-4db3-8e30-92a83150faee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:44:32.974370 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:32.975021 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:33.025824 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:33.026840 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:33.055259 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] [instance: a96a21dd-f3b7-461e-80f8-1e6ff437c348] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:44:33.056383 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:33.060333 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:33.088307 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] [instance: a96a21dd-f3b7-461e-80f8-1e6ff437c348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:44:33.098223 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:33.099247 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:33.168045 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:44:33.168671 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-63981362-b0a1-4ee0-975b-6f2d450f8099 tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:44:36.864758 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:44:37.890047 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 39648. Dec 16 07:44:48.391102 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:45:00.402890 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Took 0.78 seconds to select destinations for 2 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:45:00.482543 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:45:00.506766 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.507171 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.543692 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.549789 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.687961 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.689414 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.732108 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.732541 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.734255 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.734665 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.842712 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.842712 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.842712 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.842712 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.848095 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:45:00.857714 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Getting quotas for user efd53baf3caf4c98b3f77b8c7d3a5cd2 and project 20c080a29661447f84afe81b2c615e09. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:45:00.903986 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: 508ea8db-6c43-4bd7-8dc5-177423bf04d9] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:45:00.904964 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.905360 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.914554 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Getting quotas for project c99327fc256f454ba5a689a2005c37fe. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:45:00.925729 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] [instance: 508ea8db-6c43-4bd7-8dc5-177423bf04d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:45:00.930077 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Getting quotas for user 5d355de174a94d31bdee817011fac050 and project c99327fc256f454ba5a689a2005c37fe. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:45:00.931383 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.931725 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.982418 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.982819 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a309a8a8-4791-4532-8ab5-e77e7b0be152 tempest-DeleteServersTestJSON-1606323636 tempest-DeleteServersTestJSON-1606323636-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:00.988553 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] [instance: 3275d920-db9b-43e6-92ee-14aa8a1b946a] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:45:00.994808 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:00.995484 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:01.012948 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] [instance: 3275d920-db9b-43e6-92ee-14aa8a1b946a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:45:01.018253 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:01.018697 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:01.089904 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:01.090527 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:01.105938 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] [instance: 9e45c6a7-1416-4b47-8c3c-7eb9e36e6618] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:45:01.107481 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:01.108100 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:01.116799 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] [instance: 9e45c6a7-1416-4b47-8c3c-7eb9e36e6618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:45:01.124734 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:01.130947 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:01.209062 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:01.218700 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f22c2e5c-7c25-4fcf-a13c-c1a6bc8fab2f tempest-MultipleCreateTestJSON-1496522715 tempest-MultipleCreateTestJSON-1496522715-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:47.070887 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:45:47.113630 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:47.114293 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:47.205307 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:47.209677 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:47.210801 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:47.211338 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:47.257564 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Getting quotas for project d1ac61dba0d64ef097b4be51660ee9b0. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:45:47.267900 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Getting quotas for user 67154b8fd50b4d49840b8181ff3e37ab and project d1ac61dba0d64ef097b4be51660ee9b0. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:45:47.304351 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] [instance: 831539d5-7d24-4312-b7f3-fec86376ae5c] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:45:47.307064 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:47.309305 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:47.320699 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] [instance: 831539d5-7d24-4312-b7f3-fec86376ae5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:45:47.324106 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:47.324676 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:45:47.373667 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:45:47.374608 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2b96ed10-5a90-4671-9bbb-e6c165d4c8c7 tempest-ImagesOneServerTestJSON-1300143723 tempest-ImagesOneServerTestJSON-1300143723-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:02.429911 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:46:02.456694 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:02.457489 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:02.555277 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:02.558441 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:02.559755 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:02.560927 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:02.606368 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Getting quotas for project 3475464cada94a96ba50a5d410a1f1cd. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:46:02.615837 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Getting quotas for user 4ecee23f98ac4b94b02be71efda0272f and project 3475464cada94a96ba50a5d410a1f1cd. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:46:02.638553 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] [instance: d052416e-59ea-4f5f-a1ed-04e6995b4014] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:46:02.641429 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:02.643905 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:02.657730 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] [instance: d052416e-59ea-4f5f-a1ed-04e6995b4014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:46:02.662605 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:02.663293 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:02.718629 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:02.719494 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b38e480a-afc7-4d71-b4bb-48aab668092f tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:22.031231 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:46:22.065151 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:22.065736 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:22.147565 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:22.148053 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:22.148999 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:22.149571 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:22.171181 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Getting quotas for project 3475464cada94a96ba50a5d410a1f1cd. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:46:22.176258 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Getting quotas for user 4ecee23f98ac4b94b02be71efda0272f and project 3475464cada94a96ba50a5d410a1f1cd. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:46:22.188151 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] [instance: 30acc30f-552c-4ec2-af14-b99a0b63b1e3] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:46:22.189415 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:22.190018 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:22.200333 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] [instance: 30acc30f-552c-4ec2-af14-b99a0b63b1e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:46:22.202168 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:22.202903 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:22.259118 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:46:22.260170 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b85f137f-0947-44e7-8743-686cabf287b2 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:46:31.539511 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:46:39.892437 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:46:40.931131 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42342. Dec 16 07:47:07.460726 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:47:07.548754 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:07.549347 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:07.690527 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:07.693859 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:07.695027 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:07.695625 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:07.771550 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Getting quotas for project b7a354f5f289422ebcab387037c4101d. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:47:07.785420 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Getting quotas for user 5a6f0303111e4cfdba1cebc1e776d3ae and project b7a354f5f289422ebcab387037c4101d. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:47:07.845223 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] [instance: 783299f2-6952-412f-b59e-95465d09f27b] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:47:07.846403 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:07.846970 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:07.861347 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] [instance: 783299f2-6952-412f-b59e-95465d09f27b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:47:07.862887 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:07.863427 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:07.921943 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:07.922625 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0dbf1eca-3d62-49c0-b2e5-d694ea5c567d tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:37.890470 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:47:38.922092 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44118. Dec 16 07:47:58.536360 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:47:58.585351 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:58.587704 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:58.705078 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:58.705672 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:58.706612 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:58.707138 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:58.732827 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Getting quotas for project b7a354f5f289422ebcab387037c4101d. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:47:58.742780 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Getting quotas for user 5a6f0303111e4cfdba1cebc1e776d3ae and project b7a354f5f289422ebcab387037c4101d. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:47:58.763413 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] [instance: ce79c1f0-3813-4bc7-bff8-056f0c1bc074] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:47:58.764686 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:58.765230 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:58.776176 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] [instance: ce79c1f0-3813-4bc7-bff8-056f0c1bc074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:47:58.778327 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:58.779031 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:47:58.838061 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:47:58.839685 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-f4e90025-c717-4f95-90a7-bc5f25a9e1b4 tempest-ServerRescueTestJSON-1008520575 tempest-ServerRescueTestJSON-1008520575-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:48:08.425110 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:48:20.027961 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:48:20.106031 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:48:20.107781 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:48:20.197454 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:48:20.197926 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:48:20.198858 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:48:20.199389 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:48:20.219327 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Getting quotas for project ff0ac55d519d44bca51a113dd2f11c42. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:48:20.225171 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Getting quotas for user 3b2d0b9c3ba74bcebad220315443c27f and project ff0ac55d519d44bca51a113dd2f11c42. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:48:20.262570 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] [instance: 1570540f-db17-4f4f-ac02-3ce6714f419f] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:48:20.263770 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:48:20.264644 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:48:20.274028 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] [instance: 1570540f-db17-4f4f-ac02-3ce6714f419f] block_device_mapping [BlockDeviceMapping(attachment_id=158e8e82-603f-4822-9cd6-b0b80b368b66,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20dc788f-c638-4c89-98ad-42de5e70eab9',volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:48:20.277599 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:48:20.278177 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:48:20.337576 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:48:20.338456 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b099173e-86ed-416e-8fb0-05ae6f4b4b69 tempest-ServersTestBootFromVolume-1066201789 tempest-ServersTestBootFromVolume-1066201789-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:48:31.727184 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-9bec4819-3aa3-49e2-9a4a-2692b90cdb69 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method unshelve_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:48:31.728899 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9bec4819-3aa3-49e2-9a4a-2692b90cdb69 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:48:31.730553 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-9bec4819-3aa3-49e2-9a4a-2692b90cdb69 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:48:32.426181 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-9bec4819-3aa3-49e2-9a4a-2692b90cdb69 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] [instance: d052416e-59ea-4f5f-a1ed-04e6995b4014] Requesting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) during scheduling {{(pid=89856) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 07:48:32.666015 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-9bec4819-3aa3-49e2-9a4a-2692b90cdb69 tempest-ServersNegativeTestJSON-1783971324 tempest-ServersNegativeTestJSON-1783971324-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:49:40.930241 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:49:41.961244 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46072. Dec 16 07:49:48.992837 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:49:49.032400 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:49:49.033217 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:49:49.137161 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:49:49.137550 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:49:49.138874 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:49:49.140215 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:49:49.212558 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:49:49.226463 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for user c46e01dab87d47f48d073dc060fe3374 and project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:49:49.257877 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 792e2c4c-bee7-4f4f-9140-a0b62949363f] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:49:49.262287 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:49:49.262850 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:49:49.274149 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 792e2c4c-bee7-4f4f-9140-a0b62949363f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:49:49.275589 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:49:49.277678 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:49:49.354858 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:49:49.355264 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-04185197-3ae7-4ca9-862f-c3c4bb987067 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:49:51.573278 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:50:04.048723 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:50:04.098033 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:04.098738 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:04.191131 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:04.191538 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:04.192261 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:04.192651 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:04.230276 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Getting quotas for project a7a293c555cb401b8e9f65a83f51ec29. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:50:04.245680 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Getting quotas for user 80002a59b4a24366aa819b246ebcd0bf and project a7a293c555cb401b8e9f65a83f51ec29. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:50:04.287943 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] [instance: 0de5dfdd-cd56-48d2-bf33-6b8c7b600d8e] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:50:04.289178 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:04.289730 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:04.300433 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] [instance: 0de5dfdd-cd56-48d2-bf33-6b8c7b600d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:50:04.305001 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:04.306811 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:04.350100 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:04.350604 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-c7119cba-957f-4145-9d83-cdd0d74f2fd5 tempest-ServersNegativeTestMultiTenantJSON-1067860872 tempest-ServersNegativeTestMultiTenantJSON-1067860872-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:11.812765 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:50:11.833509 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: fb723e0f-f608-4fa7-b004-a60152432789] While scheduling instance, the build request was already deleted. {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1563}} Dec 16 07:50:12.223086 n-d-816927-3 nova-conductor[89857]: INFO nova.scheduler.client.report [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Deleted allocation for instance fb723e0f-f608-4fa7-b004-a60152432789 Dec 16 07:50:12.232114 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:12.232508 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:12.233210 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:12.234231 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:12.286707 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:50:12.294930 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-54d18333-e19b-456f-a950-62403bb75acb tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for user c46e01dab87d47f48d073dc060fe3374 and project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:50:14.496727 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:50:14.542757 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:14.543906 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:14.678585 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:14.684613 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:14.685768 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:14.687908 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:14.731475 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Getting quotas for project c40dfd10bde743608dd5e28aa579b3fb. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:50:14.741381 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Getting quotas for user cd272b94c84648799a63502fb702c773 and project c40dfd10bde743608dd5e28aa579b3fb. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:50:14.759622 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] [instance: 0b119662-480d-47c6-9726-fb4269c73f23] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:50:14.760855 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:14.761395 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:14.771462 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] [instance: 0b119662-480d-47c6-9726-fb4269c73f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:50:14.773199 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:14.773840 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:14.823031 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:14.824045 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-248008ec-9294-4b8d-b040-76c54694e235 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:15.126026 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:50:15.165131 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:15.169086 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:15.267998 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:15.268837 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:15.269733 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:15.270292 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:15.325979 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:50:15.347848 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for user c46e01dab87d47f48d073dc060fe3374 and project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:50:15.374376 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 74bc4b68-7362-44ff-a203-0a2d2378ac1c] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:50:15.375365 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:15.380390 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:15.391127 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 74bc4b68-7362-44ff-a203-0a2d2378ac1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:50:15.392581 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:15.393637 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:15.457429 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:15.458558 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2fbd22c8-9d63-4837-ab6a-77eb0dcd1f9b tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:16.693723 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:50:16.746128 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:16.746724 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:16.881287 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:16.882095 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:16.883045 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:16.883639 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:16.913764 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Getting quotas for project c40dfd10bde743608dd5e28aa579b3fb. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:50:16.928694 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Getting quotas for user cd272b94c84648799a63502fb702c773 and project c40dfd10bde743608dd5e28aa579b3fb. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:50:16.940786 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] [instance: c183602c-f72d-49a7-b2a3-1e92312dce52] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:50:16.946323 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:16.946852 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:16.966831 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] [instance: c183602c-f72d-49a7-b2a3-1e92312dce52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:50:16.968232 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:16.968731 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:17.020870 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:17.021372 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cff3e473-9127-476b-8fde-65bd2cb8217c tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:18.283555 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:50:18.323709 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:18.324103 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:18.423221 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:18.423899 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:18.425565 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:18.430574 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:18.473223 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Getting quotas for project c40dfd10bde743608dd5e28aa579b3fb. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:50:18.487809 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Getting quotas for user cd272b94c84648799a63502fb702c773 and project c40dfd10bde743608dd5e28aa579b3fb. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:50:18.511321 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] [instance: f81e6e39-f6f4-4efc-9450-5e40ad88229a] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:50:18.512432 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:18.514574 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:18.539766 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] [instance: f81e6e39-f6f4-4efc-9450-5e40ad88229a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:50:18.541613 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:18.543651 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:18.592700 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:18.593572 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2d423397-9d3a-4315-8daf-189b534de915 tempest-ListServerFiltersTestJSON-1754750406 tempest-ListServerFiltersTestJSON-1754750406-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:38.922708 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 07:50:39.989437 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47338. Dec 16 07:50:56.868170 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:50:56.914572 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:56.916597 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:57.018642 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:57.021732 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:57.022824 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:57.023309 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:57.063793 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:50:57.073105 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for user c46e01dab87d47f48d073dc060fe3374 and project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:50:57.100797 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: c77f6dd4-643d-430b-82df-57fa2445a20f] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:50:57.102288 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:57.102695 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:57.119789 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: c77f6dd4-643d-430b-82df-57fa2445a20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:50:57.121049 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:57.121449 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:50:57.171890 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:50:57.172298 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-cf62ae05-1330-498d-891c-cadcb520ce33 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:21.743281 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:51:21.805000 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:21.805411 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:21.916190 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:21.917178 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:21.918080 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:21.921716 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:21.956042 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Getting quotas for project 17180b050f624fe6a953d28d37687919. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:51:21.967904 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Getting quotas for user 5c4b471216914097a7d1c8bdda2e9d26 and project 17180b050f624fe6a953d28d37687919. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:51:21.992939 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] [instance: ec595ef6-2a09-405f-a2ab-0060e82d6fb8] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:51:21.994292 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:21.994875 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:22.009022 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] [instance: ec595ef6-2a09-405f-a2ab-0060e82d6fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:51:22.010568 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:22.011046 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:22.050055 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:22.050758 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-8ac87f69-b8bc-4fe7-bd13-9cc3ae179ca9 tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:24.222427 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:51:24.262659 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:24.263066 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:24.368666 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:24.370730 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:24.372028 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:24.372642 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:24.392678 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:51:24.397610 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for user c46e01dab87d47f48d073dc060fe3374 and project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:51:24.409630 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 1cdaf28f-2715-4a04-9a9e-ef49de8b5230] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:51:24.410608 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:24.411002 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:24.419262 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 1cdaf28f-2715-4a04-9a9e-ef49de8b5230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:51:24.420683 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:24.421120 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:24.469597 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:24.470167 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55c549db-46ce-4632-8ae2-ddafb119715c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:28.451833 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:51:46.006506 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:51:46.037244 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:46.037864 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:46.085282 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:46.086758 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:46.090150 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:46.090607 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:46.109841 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:51:46.115286 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for user c46e01dab87d47f48d073dc060fe3374 and project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:51:46.129671 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 30791d27-bbb6-4a2c-a60a-30fee230640e] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:51:46.130931 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:46.131532 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:46.140783 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 30791d27-bbb6-4a2c-a60a-30fee230640e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:51:46.142339 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:46.143009 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:46.181237 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:46.181637 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-66b486d7-2c36-4a07-adda-730833e1c49d tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:54.532040 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:51:54.568079 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:54.568836 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:54.638436 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:54.639023 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:54.640980 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:54.641359 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:54.660674 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Getting quotas for project f718a55df2cc4e4790b81e2337c3cf19. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:51:54.670043 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Getting quotas for user f31c26e053dc4dcb82a067102e7754d3 and project f718a55df2cc4e4790b81e2337c3cf19. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:51:54.685491 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] [instance: 76a7cc17-f95b-486e-9642-22e11cd0a2be] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:51:54.687282 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:54.688054 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:54.696195 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] [instance: 76a7cc17-f95b-486e-9642-22e11cd0a2be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:51:54.697673 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:54.698384 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:51:54.745267 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:51:54.745709 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-911846e6-a0fd-46b1-ac65-ec678a520e7b tempest-ServerAddressesTestJSON-732321496 tempest-ServerAddressesTestJSON-732321496-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:12.384721 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:52:12.439827 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:12.440219 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:12.512772 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:12.513605 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:12.514840 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:12.515608 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:12.540524 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:52:12.547042 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for user c46e01dab87d47f48d073dc060fe3374 and project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:52:12.587726 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 263d0564-869a-469f-bc3b-02f671ec43b7] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:52:12.589246 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:12.589974 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:12.600478 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: 263d0564-869a-469f-bc3b-02f671ec43b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:52:12.602131 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:12.602754 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:12.638927 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:12.639640 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-94217c6e-7161-4741-8a9b-1d2f50d7dae3 tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:23.168505 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:52:23.214553 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:23.214725 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:23.331673 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:23.332356 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:23.334038 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:23.334647 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:23.370849 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Getting quotas for project 17180b050f624fe6a953d28d37687919. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:52:23.380258 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Getting quotas for user 5c4b471216914097a7d1c8bdda2e9d26 and project 17180b050f624fe6a953d28d37687919. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:52:23.394339 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] [instance: 379f630a-cd86-4de1-a726-6228bb1c08bb] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:52:23.395385 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:23.395840 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:23.417890 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] [instance: 379f630a-cd86-4de1-a726-6228bb1c08bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:52:23.419946 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:23.421195 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:23.479602 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:23.480463 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-1676d6ff-8940-4a0b-ade4-720c7221de1f tempest-ServersTestMultiNic-1665473967 tempest-ServersTestMultiNic-1665473967-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:34.453819 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:52:34.494680 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:34.495197 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:34.565536 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:34.566261 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:34.567345 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:34.567965 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:34.587608 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Getting quotas for project 980fa3d920804e1db66ff146f9b0b6fa. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:52:34.594138 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Getting quotas for user 0aefe68ec5b24aa1b488b1eccfb7a982 and project 980fa3d920804e1db66ff146f9b0b6fa. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:52:34.607241 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] [instance: e0d85deb-a489-44f6-b9a1-d44218f1b7f9] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:52:34.608345 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:34.608739 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:34.621041 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] [instance: e0d85deb-a489-44f6-b9a1-d44218f1b7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:52:34.623066 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:34.623832 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:34.666991 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:34.667663 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-a47c078f-c83f-4b4d-b11c-1202dcd90e33 tempest-ServerRescueTestJSONUnderV235-1036429005 tempest-ServerRescueTestJSONUnderV235-1036429005-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:41.963396 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 07:52:42.989886 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50488. Dec 16 07:52:44.764459 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:52:44.822250 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:44.823065 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:44.994427 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:44.999551 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:45.000351 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:45.000739 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:45.034066 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:52:45.040709 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Getting quotas for user c46e01dab87d47f48d073dc060fe3374 and project 3c0eb1dc395d42f89a1c3103e547df3c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:52:45.054532 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: b19d568d-e89f-45a1-80f8-d8c063205721] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:52:45.055932 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:45.056473 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:45.065810 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] [instance: b19d568d-e89f-45a1-80f8-d8c063205721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:52:45.067520 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:45.068152 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:52:45.108208 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:52:45.108621 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-19ae8c0b-4125-4914-9b21-facb14cb358c tempest-ServersTestJSON-1678337712 tempest-ServersTestJSON-1678337712-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:53:11.600909 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:53:29.723448 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:53:29.771530 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:53:29.772240 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:53:29.856615 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:53:29.857641 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:53:29.860949 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:53:29.861647 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:53:29.929087 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Getting quotas for project fb49059fa68045db98d0610e8f905919. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:53:29.937250 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Getting quotas for user 0b6380af538e41b0bb4e19c6a0845e6f and project fb49059fa68045db98d0610e8f905919. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:53:29.955156 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] [instance: b60910c3-91a8-48f1-96a7-02d0173fe6fd] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:53:29.957047 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:53:29.957648 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:53:29.967473 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] [instance: b60910c3-91a8-48f1-96a7-02d0173fe6fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:53:29.969476 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:53:29.970204 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:53:30.022787 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:53:30.023014 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-46c8d375-7748-4e24-b006-ebbe286f30a7 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:53:39.981330 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:53:41.050364 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 51330. Dec 16 07:53:48.857122 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-35bceffc-9462-42bc-b685-c81fd5c864ce tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method rebuild_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:53:48.857704 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-35bceffc-9462-42bc-b685-c81fd5c864ce tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:53:48.858040 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-35bceffc-9462-42bc-b685-c81fd5c864ce tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:53:48.887366 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-35bceffc-9462-42bc-b685-c81fd5c864ce tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] [instance: b60910c3-91a8-48f1-96a7-02d0173fe6fd] No migration record for the rebuild/evacuate request. {{(pid=89856) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 07:53:48.951536 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_db.api [None req-35bceffc-9462-42bc-b685-c81fd5c864ce tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 16 07:53:48.951536 n-d-816927-3 nova-conductor[89856]: [SQL: UPDATE instance_actions SET updated_at=%(updated_at)s WHERE instance_actions.id = %(instance_actions_id)s] Dec 16 07:53:48.951536 n-d-816927-3 nova-conductor[89856]: [parameters: {'updated_at': datetime.datetime(2021, 12, 16, 7, 53, 48, 926016), 'instance_actions_id': 308}] Dec 16 07:53:48.951536 n-d-816927-3 nova-conductor[89856]: (Background on this error at: http://sqlalche.me/e/13/e3q8) {{(pid=89856) _is_exception_expected /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:184}} Dec 16 07:53:48.952580 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_db.api [None req-35bceffc-9462-42bc-b685-c81fd5c864ce tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Performing DB retry for function nova.db.sqlalchemy.api.action_event_finish {{(pid=89856) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 16 07:54:26.254413 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:54:26.292383 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:26.293114 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:26.381845 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:26.382535 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:26.383417 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:26.384005 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:26.400732 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Getting quotas for project c7f7168972b540a3ad57059820460108. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:54:26.406064 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Getting quotas for user 309d56b477b04ccc8ed53ad1aeb9d8e3 and project c7f7168972b540a3ad57059820460108. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:54:26.418296 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] [instance: fedc366d-d5bd-4e92-9a02-38a8f415687e] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:54:26.419717 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:26.420598 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:26.429129 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] [instance: fedc366d-d5bd-4e92-9a02-38a8f415687e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:54:26.430560 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:26.431147 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:26.467735 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:26.468482 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cc21c328-b82a-4d5f-a498-e1b441288b91 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:27.834191 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:27.834701 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:28.411403 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:54:28.475191 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:28.475634 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:28.556604 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:28.557476 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:28.558597 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:28.559206 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:28.576626 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Getting quotas for project 261d810c45c24f6b89a9d5c51a4d45bf. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:54:28.581973 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Getting quotas for user 266841aebae34bd18ecf42ceeee4088d and project 261d810c45c24f6b89a9d5c51a4d45bf. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:54:28.593978 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] [instance: d5c908d5-09d2-4f63-80ff-584a404e5253] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:54:28.595217 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:28.595767 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:28.603954 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] [instance: d5c908d5-09d2-4f63-80ff-584a404e5253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:54:28.605811 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:28.606393 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:28.642360 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:28.642811 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e2430b69-8710-4a1b-94e0-deb9184b851c tempest-ServerGroupTestJSON-1698350215 tempest-ServerGroupTestJSON-1698350215-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:30.950783 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:54:30.990064 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:30.996984 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:31.029452 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-3c6b9aab-d8c7-4860-8d6b-451b5ffe0b93 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method rebuild_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:54:31.030227 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3c6b9aab-d8c7-4860-8d6b-451b5ffe0b93 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:31.030804 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-3c6b9aab-d8c7-4860-8d6b-451b5ffe0b93 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:31.057225 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:31.058212 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:31.059328 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:31.059945 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:31.065082 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-3c6b9aab-d8c7-4860-8d6b-451b5ffe0b93 tempest-ServerShowV257Test-1832685590 tempest-ServerShowV257Test-1832685590-project] [instance: fedc366d-d5bd-4e92-9a02-38a8f415687e] No migration record for the rebuild/evacuate request. {{(pid=89856) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 07:54:31.080683 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Getting quotas for project fb49059fa68045db98d0610e8f905919. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:54:31.087201 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Getting quotas for user 0b6380af538e41b0bb4e19c6a0845e6f and project fb49059fa68045db98d0610e8f905919. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:54:31.104954 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] [instance: 5613b502-fd39-4624-93d5-d621966a35bd] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:54:31.106768 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:31.107519 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:31.131505 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] [instance: 5613b502-fd39-4624-93d5-d621966a35bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:54:31.137633 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:31.138551 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:31.196304 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:31.196938 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-d4de3110-16b4-4496-be32-f989d2b176a2 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:48.446320 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-68c71ffe-1f24-4eb3-b1e0-79c744b07a46 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method rebuild_instance {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:54:48.449122 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-68c71ffe-1f24-4eb3-b1e0-79c744b07a46 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:48.449519 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-68c71ffe-1f24-4eb3-b1e0-79c744b07a46 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:48.478333 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-68c71ffe-1f24-4eb3-b1e0-79c744b07a46 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] [instance: 5613b502-fd39-4624-93d5-d621966a35bd] No migration record for the rebuild/evacuate request. {{(pid=89857) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 07:54:58.589601 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:54:58.615109 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:58.615671 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:58.669079 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:58.669614 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:58.670522 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:58.671026 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:58.688224 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Getting quotas for project 0249753a9d6a4884a9eba2875229ff5e. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:54:58.692964 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Getting quotas for user 6626a3d0049249bfaa75bee51c9e8e32 and project 0249753a9d6a4884a9eba2875229ff5e. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:54:58.704226 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] [instance: 04115efa-f6ba-4e58-b934-cf2e2dc24216] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:54:58.705311 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:58.705854 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:58.714749 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] [instance: 04115efa-f6ba-4e58-b934-cf2e2dc24216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:54:58.716173 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:58.716670 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:54:58.748797 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:54:58.749276 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-09c50183-8aa5-40d3-bb4f-e7d5efe5f2c8 tempest-ServerMetadataNegativeTestJSON-706983495 tempest-ServerMetadataNegativeTestJSON-706983495-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:11.172333 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:55:11.206944 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:11.207734 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:11.277260 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:11.277707 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:11.280363 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:11.280363 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:11.318560 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Getting quotas for project f553a608978b4cd6b93102d41040e5de. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:55:11.330756 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Getting quotas for user 10630f0056c5479a8ac91a1bab2f65d5 and project f553a608978b4cd6b93102d41040e5de. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:55:11.353283 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] [instance: f0e367b1-fd75-450f-a086-2e24ad42c908] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:55:11.355101 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:11.355661 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:11.379371 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] [instance: f0e367b1-fd75-450f-a086-2e24ad42c908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:55:11.380860 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:11.381413 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:11.441794 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:11.442445 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b4289d56-e8e4-413b-acc4-510f2d7ff6c5 tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:31.451531 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:55:31.504289 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:31.504874 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:31.591708 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:31.592104 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:31.592818 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:31.593194 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:31.619293 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Getting quotas for project fb49059fa68045db98d0610e8f905919. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:55:31.624473 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Getting quotas for user 0b6380af538e41b0bb4e19c6a0845e6f and project fb49059fa68045db98d0610e8f905919. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:55:31.636500 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] [instance: 9d35f1e3-9f00-4592-80ea-c46afbdfab60] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:55:31.637683 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:31.638237 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:31.646454 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] [instance: 9d35f1e3-9f00-4592-80ea-c46afbdfab60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:55:31.648010 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:31.648611 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:31.699153 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:31.699797 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d9c5fcd8-41b0-4bd3-9fd8-a2b05f31d318 tempest-ServerDiskConfigTestJSON-497541837 tempest-ServerDiskConfigTestJSON-497541837-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:41.550526 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:55:41.574921 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:41.575327 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:41.649380 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:41.652616 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:41.653405 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:41.653928 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:41.673329 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Getting quotas for project f553a608978b4cd6b93102d41040e5de. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:55:41.678930 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Getting quotas for user 10630f0056c5479a8ac91a1bab2f65d5 and project f553a608978b4cd6b93102d41040e5de. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:55:41.692688 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] [instance: 7d7af469-96c7-4c45-b0b7-c88d3c165db1] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:55:41.694035 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:41.694440 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:41.703788 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] [instance: 7d7af469-96c7-4c45-b0b7-c88d3c165db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:55:41.706016 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:41.706721 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:41.759252 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:55:41.759789 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9567fcc8-310c-4db7-8a23-4c69978beb6e tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:55:42.991545 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:55:44.016464 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54036. Dec 16 07:56:05.988943 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:56:06.024605 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:06.024933 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:06.114966 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:06.115613 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:06.116701 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:06.117332 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:06.135293 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Getting quotas for project f553a608978b4cd6b93102d41040e5de. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:56:06.141062 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Getting quotas for user 10630f0056c5479a8ac91a1bab2f65d5 and project f553a608978b4cd6b93102d41040e5de. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:56:06.153984 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] [instance: a6874418-70b0-4200-8a03-b4c76f4bbedc] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:56:06.155496 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:06.156109 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:06.171037 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] [instance: a6874418-70b0-4200-8a03-b4c76f4bbedc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:56:06.172559 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:06.173160 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:06.234070 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:06.234895 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-175b521b-6da2-4c10-b035-b453e7ab851a tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:25.384727 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:56:25.424321 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:25.425826 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:25.507818 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:25.508339 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:25.508900 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:25.509277 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:25.527112 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Getting quotas for project 42145bcf2e37438bb6544a2d9a172e42. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:56:25.532432 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Getting quotas for user 9e9195852de94be49959f28f50e9b043 and project 42145bcf2e37438bb6544a2d9a172e42. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:56:25.547556 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] [instance: a8dbc0e2-b7a6-4f82-ba4b-369a1fbeca17] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:56:25.548621 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:25.549017 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:25.558945 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] [instance: a8dbc0e2-b7a6-4f82-ba4b-369a1fbeca17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:56:25.560481 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:25.560774 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:25.603696 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:25.604543 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-69a3e653-fe67-43fc-85f0-14781063cc1c tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:38.543767 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:56:38.599067 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:38.604257 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:38.680013 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:38.680473 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:38.681283 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:38.683862 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:38.704283 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Getting quotas for project f553a608978b4cd6b93102d41040e5de. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 07:56:38.710624 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Getting quotas for user 10630f0056c5479a8ac91a1bab2f65d5 and project f553a608978b4cd6b93102d41040e5de. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 07:56:38.722797 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] [instance: a050ab32-9f12-43b6-8a6f-b9d079d381d5] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 07:56:38.724510 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:38.725204 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:38.738036 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] [instance: a050ab32-9f12-43b6-8a6f-b9d079d381d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 07:56:38.739890 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:38.741295 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:38.806609 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:56:38.807382 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-416b3c39-6633-426b-baf8-67a6d72fc2ec tempest-AttachVolumeNegativeTest-1815861516 tempest-AttachVolumeNegativeTest-1815861516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:56:41.048703 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 07:56:42.069859 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55350. Dec 16 07:58:32.338591 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:58:32.396441 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:58:33.361816 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57620. Dec 16 07:58:33.847998 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:58:44.015120 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 07:58:45.034946 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58284. Dec 16 07:59:11.275908 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:59:11.280854 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 07:59:12.308381 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58946. Dec 16 07:59:12.324724 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58944. Dec 16 07:59:12.761489 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e6fc30c7-4f75-44d1-98e5-d7f14518c4a4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method unshelve_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 07:59:12.762371 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e6fc30c7-4f75-44d1-98e5-d7f14518c4a4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 07:59:12.762933 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e6fc30c7-4f75-44d1-98e5-d7f14518c4a4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 07:59:13.343959 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e6fc30c7-4f75-44d1-98e5-d7f14518c4a4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] [instance: a8dbc0e2-b7a6-4f82-ba4b-369a1fbeca17] Requesting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) during scheduling {{(pid=89856) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 07:59:13.651653 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e6fc30c7-4f75-44d1-98e5-d7f14518c4a4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 07:59:42.070093 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 07:59:43.090662 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59514. Dec 16 07:59:48.511849 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 07:59:51.641191 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:00:49.070709 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Took 1.34 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:00:49.117022 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:49.117508 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:49.186759 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:49.187747 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:49.188810 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:49.189438 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:49.234048 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Getting quotas for project 42145bcf2e37438bb6544a2d9a172e42. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:00:49.241665 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Getting quotas for user 9e9195852de94be49959f28f50e9b043 and project 42145bcf2e37438bb6544a2d9a172e42. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:00:49.275760 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] [instance: 7ccf1b2e-e646-4103-8268-e2e7990f8403] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:00:49.279143 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:49.279815 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:49.291482 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] [instance: 7ccf1b2e-e646-4103-8268-e2e7990f8403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:00:49.295247 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:49.296035 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:49.340164 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:49.340804 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-325ef7ea-a0bb-4b8f-8457-29a26fbe3cd2 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:58.895164 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:00:58.931587 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:58.932228 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:59.005925 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:59.006329 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:59.007253 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:59.008456 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:59.024349 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Getting quotas for project b1fea1679a9d4cc4aadf1a794d47d60c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:00:59.029683 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Getting quotas for user 2bbc3c19e1704456b4447b10884aefa4 and project b1fea1679a9d4cc4aadf1a794d47d60c. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:00:59.040327 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] [instance: 8f10ee4d-c05b-4576-b690-60470cee0904] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:00:59.041269 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:59.041664 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:59.050151 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] [instance: 8f10ee4d-c05b-4576-b690-60470cee0904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:00:59.051765 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:59.052182 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:00:59.094075 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:00:59.094644 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-ca05ccd0-6317-483b-8d6b-b736ad666861 tempest-VolumesActionsTest-1879064216 tempest-VolumesActionsTest-1879064216-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:01:45.039267 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:01:46.064543 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 35206. Dec 16 08:02:39.449024 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:02:39.479354 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:39.479889 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:39.543154 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:39.543546 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:39.544324 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:39.544709 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:39.584385 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Getting quotas for project 124d87b682fe416989b67758e991bcc0. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:02:39.590728 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Getting quotas for user 6f0c2759fd3641fb96780659e324efc3 and project 124d87b682fe416989b67758e991bcc0. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:02:39.601203 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] [instance: a6d9dcba-d456-4c9f-a205-7a8e551cda57] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:02:39.601203 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:39.601203 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:39.613526 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] [instance: a6d9dcba-d456-4c9f-a205-7a8e551cda57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:02:39.613526 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:39.613526 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:39.677394 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:39.677394 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-b255f6ca-4f49-46c8-8561-953376a1b1ea tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:43.113471 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:02:44.211210 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 36688. Dec 16 08:02:45.450060 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:02:45.478485 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:45.478485 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:45.564557 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:45.564557 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:45.564557 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:45.564557 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:45.592190 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Getting quotas for project db19ada32d15454c9d82b242238cee75. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:02:45.598102 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Getting quotas for user e4e992f8ebe043adb944cc4a5a652f9f and project db19ada32d15454c9d82b242238cee75. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:02:45.606606 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] [instance: e0e1aaa3-a73b-405f-a35b-5a5b8d448ae8] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:02:45.606606 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:45.615928 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:45.627725 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] [instance: e0e1aaa3-a73b-405f-a35b-5a5b8d448ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:02:45.627725 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:45.637391 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:02:45.674641 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:02:45.675416 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fed182d6-a9dc-4700-8813-e70a2b18810c tempest-TestServerAdvancedOps-315181923 tempest-TestServerAdvancedOps-315181923-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:08.545310 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:03:11.680487 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:03:17.353691 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-ab0ae7e9-b086-421d-a1a4-1127ee020bf4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method unshelve_instance {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:03:17.354357 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ab0ae7e9-b086-421d-a1a4-1127ee020bf4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:17.354586 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-ab0ae7e9-b086-421d-a1a4-1127ee020bf4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:17.827609 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-ab0ae7e9-b086-421d-a1a4-1127ee020bf4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] [instance: 7ccf1b2e-e646-4103-8268-e2e7990f8403] Requesting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) during scheduling {{(pid=89857) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 08:03:18.110619 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-ab0ae7e9-b086-421d-a1a4-1127ee020bf4 tempest-AttachVolumeShelveTestJSON-675327008 tempest-AttachVolumeShelveTestJSON-675327008-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:03:39.861313 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:03:39.890380 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:39.890911 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:39.963762 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:39.964229 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:39.965031 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:39.965500 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:39.982618 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Getting quotas for project 124d87b682fe416989b67758e991bcc0. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:03:39.987168 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Getting quotas for user 6f0c2759fd3641fb96780659e324efc3 and project 124d87b682fe416989b67758e991bcc0. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:03:39.997871 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] [instance: 8f866d6e-afce-432f-b11d-15d097b237ca] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:03:39.998914 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:39.999359 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:40.006799 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] [instance: 8f866d6e-afce-432f-b11d-15d097b237ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:03:40.008364 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:40.008908 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:40.048196 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:40.048970 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0a360ed0-1ce8-4104-8409-86ab016052fe tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:44.856290 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:03:44.911730 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:44.911730 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:44.997366 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:44.997862 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:44.998631 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:44.999071 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:45.016018 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Getting quotas for project 0ad52b37a218412697171784774bf866. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:03:45.020559 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Getting quotas for user 1fafbe71afb144c3b6ff9ebce6f246a7 and project 0ad52b37a218412697171784774bf866. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:03:45.035249 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] [instance: 5417585a-130a-4d77-bd76-3c2d3ca17df0] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:03:45.036259 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:45.036825 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:45.045406 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] [instance: 5417585a-130a-4d77-bd76-3c2d3ca17df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:03:45.046927 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:45.047412 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:03:45.088226 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:03:45.088651 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c0c39087-6c7f-45da-9949-204bb5e627d3 tempest-TestServerBasicOps-624720984 tempest-TestServerBasicOps-624720984-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:46.064751 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:04:47.095620 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 39536. Dec 16 08:04:50.267562 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:04:50.326829 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:50.328416 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:50.444334 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:50.445102 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:50.446139 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:50.446711 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:50.467467 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Getting quotas for project ad66d05183f44f9dbe83943e9164321a. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:04:50.474072 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Getting quotas for user 1fe6282eaab74e978ec0439b97177e11 and project ad66d05183f44f9dbe83943e9164321a. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:04:50.490779 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] [instance: 8b8e754f-fada-466a-b402-e32a8e656a50] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:04:50.492608 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:50.493245 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:50.504233 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] [instance: 8b8e754f-fada-466a-b402-e32a8e656a50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:04:50.506402 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:50.507026 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:50.572382 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:50.573829 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5949f75c-5b98-4f8d-a929-f0f53ecd87f7 tempest-VolumesNegativeTest-1660380346 tempest-VolumesNegativeTest-1660380346-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:52.026040 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:04:52.061298 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:52.061872 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:52.119602 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:52.120232 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:52.121049 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:52.121522 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:52.139408 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Getting quotas for project c3f7656c1add421b81912df06905a4de. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:04:52.145571 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Getting quotas for user 1c6b31140a2d4f03be7d38a830b3716d and project c3f7656c1add421b81912df06905a4de. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:04:52.158061 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] [instance: ecc8a2dd-2390-4210-bc18-984627c7dcd1] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:04:52.159568 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:52.160661 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:52.170420 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] [instance: ecc8a2dd-2390-4210-bc18-984627c7dcd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:04:52.172272 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:52.174288 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:04:52.211788 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:04:52.212339 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-458c80c0-429f-4819-93d0-61977c38b936 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:05:02.633531 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:05:02.655474 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:05:02.655825 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:05:02.701939 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:05:02.702341 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:05:02.703051 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:05:02.703423 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:05:02.718461 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Getting quotas for project 124d87b682fe416989b67758e991bcc0. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:05:02.722822 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Getting quotas for user 6f0c2759fd3641fb96780659e324efc3 and project 124d87b682fe416989b67758e991bcc0. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:05:02.732898 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] [instance: 2e588b32-92d3-4811-9bbe-027d0b8b5e61] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:05:02.733863 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:05:02.734233 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:05:02.741575 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] [instance: 2e588b32-92d3-4811-9bbe-027d0b8b5e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:05:02.742742 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:05:02.743125 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:05:02.770913 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:05:02.771303 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-55b57de3-3dd1-4c85-be91-3665d07c499a tempest-TestNetworkBasicOps-1232022339 tempest-TestNetworkBasicOps-1232022339-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:05:44.202689 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:05:45.243806 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 40380. Dec 16 08:06:09.489332 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:06:09.511425 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:06:09.511819 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:06:09.562915 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:06:09.563329 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:06:09.563996 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:06:09.564457 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:06:09.579828 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Getting quotas for project 83c36e0cc4e044b0bdefc583abe056b4. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:06:09.584318 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Getting quotas for user 63200ebebd9e4e90ad591bd814374357 and project 83c36e0cc4e044b0bdefc583abe056b4. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:06:09.595115 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] [instance: c3db81b0-27e0-4fcd-a03c-c9a61c82a3f6] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:06:09.596015 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:06:09.596395 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:06:09.605016 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] [instance: c3db81b0-27e0-4fcd-a03c-c9a61c82a3f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:06:09.606159 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:06:09.606779 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:06:09.635362 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:06:09.635748 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c3a8f284-83e5-4862-b0c6-d13305e25f9f tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:06:28.572868 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:06:31.706866 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:07:10.052233 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:07:10.075124 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:07:10.075515 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:07:10.120446 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:07:10.120825 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:07:10.121537 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:07:10.121940 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:07:10.136281 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Getting quotas for project 83c36e0cc4e044b0bdefc583abe056b4. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:07:10.140786 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Getting quotas for user 63200ebebd9e4e90ad591bd814374357 and project 83c36e0cc4e044b0bdefc583abe056b4. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:07:10.151380 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] [instance: 6f81b780-4bf3-4384-93fd-237b0e8215bc] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:07:10.152257 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:07:10.152650 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:07:10.161073 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] [instance: 6f81b780-4bf3-4384-93fd-237b0e8215bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:07:10.162406 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:07:10.162840 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:07:10.194376 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:07:10.195031 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2fdb8298-2c8b-4d3f-938e-61f7f4ae6806 tempest-VolumesSnapshotTestJSON-1062378743 tempest-VolumesSnapshotTestJSON-1062378743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:07:47.095822 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:07:48.113443 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42004. Dec 16 08:08:12.322986 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:08:13.346063 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42120. Dec 16 08:08:32.443095 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:08:33.371029 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:08:33.913407 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:08:34.388452 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42294. Dec 16 08:08:41.494632 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:08:41.524226 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:41.524639 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:41.588296 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:41.588897 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:41.589887 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:41.590454 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:41.609056 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Getting quotas for project c3f7656c1add421b81912df06905a4de. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:08:41.614155 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Getting quotas for user 1c6b31140a2d4f03be7d38a830b3716d and project c3f7656c1add421b81912df06905a4de. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:08:41.626527 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] [instance: 46486b06-41ed-46cc-9fc4-9d34c96a1fe8] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:08:41.627786 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:41.628358 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:41.638518 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] [instance: 46486b06-41ed-46cc-9fc4-9d34c96a1fe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:08:41.640121 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:41.640757 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:41.676711 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:41.677338 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-36645076-5d1d-4086-90c0-c62096fb9600 tempest-AttachVolumeTestJSON-64499815 tempest-AttachVolumeTestJSON-64499815-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:43.746798 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:08:43.786016 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:43.787066 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:43.949822 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:43.950522 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:43.951721 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:43.952285 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:43.973436 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Getting quotas for project a47708170e154089bb6908b2ba9cb73e. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:08:43.978640 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Getting quotas for user a83d4e71368f40d2800250aefbbfbd4d and project a47708170e154089bb6908b2ba9cb73e. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:08:43.993389 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] [instance: 7e6e51ca-355e-4515-a766-2ccdab69935a] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:08:43.994694 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:43.995264 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:44.007323 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] [instance: 7e6e51ca-355e-4515-a766-2ccdab69935a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:08:44.012236 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:44.014635 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:44.068225 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:08:44.068673 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-39e38ad9-aeb4-47de-8c88-dfc0465ac70d tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:08:45.222824 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:08:46.247294 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42434. Dec 16 08:09:39.769237 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:09:39.791416 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:09:39.792069 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:09:39.837810 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:09:39.838220 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:09:39.839033 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:09:39.839287 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:09:39.854686 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Getting quotas for project a47708170e154089bb6908b2ba9cb73e. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:09:39.859320 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Getting quotas for user a83d4e71368f40d2800250aefbbfbd4d and project a47708170e154089bb6908b2ba9cb73e. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:09:39.869581 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] [instance: 4ac52db8-4cb0-4be9-b731-7afacd917f2c] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:09:39.870532 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:09:39.870895 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:09:39.881495 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] [instance: 4ac52db8-4cb0-4be9-b731-7afacd917f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:09:39.882925 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:09:39.883368 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:09:39.915589 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:09:39.916025 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-fb7c7be0-ffd0-4d73-a429-85bcaea8a5ac tempest-TestSecurityGroupsBasicOps-1147862385 tempest-TestSecurityGroupsBasicOps-1147862385-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:09:48.596904 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:09:51.736088 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:10:29.887485 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:10:29.920595 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:29.921507 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:29.980563 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:29.981039 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:29.981844 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:29.982503 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:29.997879 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Getting quotas for project f6e56eec21c247b6add506947e5f697e. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:10:30.002423 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Getting quotas for user 67aaff148cb14ac6a9ac2e68849fef74 and project f6e56eec21c247b6add506947e5f697e. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:10:30.012818 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] [instance: b4ff0df3-ad52-49dc-bf6a-47ac4deb4ea5] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:10:30.013372 n-d-816927-3 nova-conductor[89857]: DEBUG nova.scheduler.utils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-816927-3']) and/or node ([]) {{(pid=89857) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Dec 16 08:10:30.014221 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:30.014620 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:30.023368 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] [instance: b4ff0df3-ad52-49dc-bf6a-47ac4deb4ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:10:30.024890 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:30.025538 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:30.053266 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:30.053853 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58d47953-db09-409f-ab54-0ff47bdfd453 tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:41.382919 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:10:41.423341 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:41.424000 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:41.481578 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:41.482014 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:41.482729 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:41.483111 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:41.499769 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Getting quotas for project f6e56eec21c247b6add506947e5f697e. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:10:41.505027 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Getting quotas for user 67aaff148cb14ac6a9ac2e68849fef74 and project f6e56eec21c247b6add506947e5f697e. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:10:41.515973 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] [instance: e6d18ba2-5c51-489a-9256-63a0eac0daa5] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:10:41.516582 n-d-816927-3 nova-conductor[89856]: DEBUG nova.scheduler.utils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-816927-3']) and/or node ([]) {{(pid=89856) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Dec 16 08:10:41.517359 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:41.517748 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:41.526486 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] [instance: e6d18ba2-5c51-489a-9256-63a0eac0daa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:10:41.527823 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:41.528183 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:41.557980 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:10:41.558376 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0f51a85b-82a3-445a-9610-0284cb6952fe tempest-TestServerMultinode-84391767 tempest-TestServerMultinode-84391767-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:10:48.113886 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:10:49.136669 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43298. Dec 16 08:11:46.247890 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:11:47.265503 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44180. Dec 16 08:12:34.390047 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:12:35.406740 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 45022. Dec 16 08:13:08.624752 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:13:11.772824 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:13:12.318082 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:13:13.349503 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:13:13.352464 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 45570. Dec 16 08:13:14.401403 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 45582. Dec 16 08:13:29.381495 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Took 2.45 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:13:29.407443 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:13:29.407849 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:13:29.462211 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:13:29.462640 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:13:29.463321 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:13:29.463734 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:13:29.479017 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Getting quotas for project 3bccf0e5294242988444da44e84e1b70. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:13:29.483411 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Getting quotas for user 1b86a1dfcf7841048ac983365e93c474 and project 3bccf0e5294242988444da44e84e1b70. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:13:29.493341 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] [instance: 9baf587b-56e5-4d31-92af-83c80ad9ab86] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:13:29.494337 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:13:29.494727 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:13:29.502115 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] [instance: 9baf587b-56e5-4d31-92af-83c80ad9ab86] block_device_mapping [BlockDeviceMapping(attachment_id=f77b8b12-7d23-422d-8af5-b984d7d59c5f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb58a6b3-72ea-4524-8ff1-4c9570f49cc8',volume_size=1,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:13:29.503334 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:13:29.503722 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:13:29.531951 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:13:29.532307 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-24f54e77-4639-464d-927f-7f09a6c8f338 tempest-TestVolumeBackupRestore-1056726164 tempest-TestVolumeBackupRestore-1056726164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:13:32.472212 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:13:33.937996 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:13:49.138567 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:13:50.163726 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 45932. Dec 16 08:14:47.272290 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:14:48.291641 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47010. Dec 16 08:15:06.357341 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:15:06.384005 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:06.384403 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:06.433953 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:06.434351 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:06.435059 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:06.438346 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:06.455117 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:15:06.459616 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for user 2c8f2921884d4689bb501a01fd3564da and project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:15:06.470266 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 1dd58226-88c5-435a-8f06-b3eb6b8cef70] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:15:06.471219 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:06.471610 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:06.481135 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 1dd58226-88c5-435a-8f06-b3eb6b8cef70] block_device_mapping [BlockDeviceMapping(attachment_id=65000a4b-0fdb-43e5-b3b1-fc179b51dae9,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c671bab9-8f37-4a51-8131-0bfb81ef902e',volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:15:06.482908 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:06.483290 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:06.514840 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:06.515300 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-1c4d74dd-368b-42cc-9d12-d9fc83e85ac2 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:36.007854 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:15:37.024445 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47742. Dec 16 08:15:50.408584 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:15:50.435579 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:50.436223 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:50.486776 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:50.487182 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:50.487947 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:50.488411 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:50.505273 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:15:50.509945 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for user 2c8f2921884d4689bb501a01fd3564da and project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:15:50.524879 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 6d032400-5ff5-445d-90a4-29881667fecc] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:15:50.525550 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:50.526099 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:50.533096 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 6d032400-5ff5-445d-90a4-29881667fecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9f42c861-8ce1-4932-a11c-2455f272c078',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:15:50.534625 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:50.535024 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:50.574886 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:50.575289 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-45ae8cd3-d713-46fe-9dd5-4d44ff3d4207 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:53.124949 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:15:53.156480 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:53.157409 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:53.223931 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:53.224328 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:53.225061 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:53.225582 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:53.243736 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Getting quotas for project 7bc93dfcb64d4ed4b55bfc8d601afad2. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:15:53.248646 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Getting quotas for user 2a945abbfc594380bd8634113265d93f and project 7bc93dfcb64d4ed4b55bfc8d601afad2. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:15:53.261347 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] [instance: 46bb0cdf-3ee9-4b51-bf52-a2b40e81a98f] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:15:53.263206 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:53.263798 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:53.280527 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] [instance: 46bb0cdf-3ee9-4b51-bf52-a2b40e81a98f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:15:53.282480 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:53.283091 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:15:53.335336 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:15:53.335753 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-58ae3d5f-86a9-4c22-a8c6-981768ce546c tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:11.069570 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:16:11.101161 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:11.101550 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:11.150013 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:11.150416 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:11.151148 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:11.151516 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:11.166643 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Getting quotas for project 7bc93dfcb64d4ed4b55bfc8d601afad2. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:16:11.171601 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Getting quotas for user 2a945abbfc594380bd8634113265d93f and project 7bc93dfcb64d4ed4b55bfc8d601afad2. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:16:11.182236 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] [instance: f57ada6c-d6ab-4da9-a5c3-6418c1bb14b4] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:16:11.183118 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:11.183508 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:11.192713 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] [instance: f57ada6c-d6ab-4da9-a5c3-6418c1bb14b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:16:11.193959 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:11.194354 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:11.223456 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:11.223844 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-412e288d-bd6d-4144-8725-3d3d5e22356e tempest-VolumesActionsTest-599509164 tempest-VolumesActionsTest-599509164-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:28.650663 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:16:31.814615 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:16:48.662456 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:16:48.684071 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:48.684652 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:48.731003 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:48.731326 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:48.732017 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:48.732385 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:48.751078 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:16:48.755499 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for user 2c8f2921884d4689bb501a01fd3564da and project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:16:48.765596 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 8c4d557b-cc35-439d-a8bb-34c86bb05a16] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:16:48.766554 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:48.766939 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:48.774415 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 8c4d557b-cc35-439d-a8bb-34c86bb05a16] block_device_mapping [BlockDeviceMapping(attachment_id=507b04d8-590e-4ef4-b366-609c1a677887,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2dd06044-0520-46f3-8b24-8af78a58a33e',volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:16:48.775642 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:48.776035 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:48.805541 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:48.805979 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-7cb01a8f-cef9-4ff6-9129-04450c9dc1e5 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:50.163450 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:16:51.185469 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48480. Dec 16 08:16:57.259286 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:16:57.284006 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:57.284403 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:57.335703 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:57.336184 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:57.336933 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:57.337315 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:57.362578 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Getting quotas for project 71ef1713dbf34d77a9e6bc33ce959409. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:16:57.367091 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Getting quotas for user a21f138e010d496dbd37551513fc06d7 and project 71ef1713dbf34d77a9e6bc33ce959409. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:16:57.377493 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] [instance: 5aaa0d05-ea06-44ed-8397-9e8808c9bc78] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:16:57.378520 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:57.378907 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:57.386284 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] [instance: 5aaa0d05-ea06-44ed-8397-9e8808c9bc78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:16:57.387478 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:57.387866 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:16:57.417274 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:16:57.417694 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-63a3ea26-9009-4f60-918a-3595e5ce043d tempest-VolumesBackupsTest-492183912 tempest-VolumesBackupsTest-492183912-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:17:09.712496 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:17:09.734126 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:17:09.734524 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:17:09.806946 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:17:09.807412 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:17:09.808474 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:17:09.809026 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:17:09.826345 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:17:09.831233 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for user 2c8f2921884d4689bb501a01fd3564da and project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:17:09.842527 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: fa27fb34-583f-4015-afd0-eeba49d4f4a7] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:17:09.843433 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:17:09.843819 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:17:09.853586 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: fa27fb34-583f-4015-afd0-eeba49d4f4a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='09c9dbfa-e5f8-4da6-b4be-14a47591d3cc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:17:09.854770 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:17:09.855156 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:17:09.894830 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:17:09.895302 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-96488c11-2b18-4132-8d59-2934770bedf4 tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:17:48.295700 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:17:49.313317 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49142. Dec 16 08:18:12.244682 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:18:12.267333 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:18:12.267811 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:18:12.314117 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:18:12.314627 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:18:12.315334 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:18:12.315716 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:18:12.331328 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:18:12.335902 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for user 2c8f2921884d4689bb501a01fd3564da and project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:18:12.347548 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 59871827-7b0a-4aaa-85e9-fed43ea98e20] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:18:12.348549 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:18:12.348942 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:18:12.356966 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 59871827-7b0a-4aaa-85e9-fed43ea98e20] block_device_mapping [BlockDeviceMapping(attachment_id=add2e1a3-2fc8-4770-a26c-74aa66000988,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c4a407a-3e6b-4f2b-81e8-13714b4608cf',volume_size=1,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:18:12.358408 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:18:12.358922 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:18:12.388103 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:18:12.388500 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-40ae7eaa-421c-4394-9df2-fed59c09dd3e tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:19:14.373391 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:19:15.397430 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50526. Dec 16 08:19:35.412685 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:19:36.438281 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50784. Dec 16 08:19:48.688371 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:19:51.183078 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:19:51.834690 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:19:52.207992 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50958. Dec 16 08:20:12.506641 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:20:13.340970 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:20:13.965902 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:20:14.370010 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 51576. Dec 16 08:20:35.847065 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:20:35.869346 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:20:35.869736 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:20:35.913218 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:20:35.913687 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:20:35.914547 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:20:35.914988 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:20:35.930414 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:20:35.934990 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for user 2c8f2921884d4689bb501a01fd3564da and project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:20:35.944968 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: abf49940-8994-4954-b8c7-c9ada6fa20ce] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:20:35.946016 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:20:35.946523 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:20:35.954394 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: abf49940-8994-4954-b8c7-c9ada6fa20ce] block_device_mapping [BlockDeviceMapping(attachment_id=d15f6b13-c7bb-4fea-bc92-9d01f66c4969,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c4a407a-3e6b-4f2b-81e8-13714b4608cf',volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:20:35.955640 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:20:35.956174 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:20:35.984227 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:20:35.984856 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c375cabe-4f7e-4e0a-97b2-bf49b8aa50cc tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:20:37.030929 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:20:38.059971 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 52046. Dec 16 08:20:49.314822 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:20:50.339780 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 52174. Dec 16 08:22:25.534912 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:22:25.560786 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:25.561177 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:25.615837 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:25.616349 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:25.617073 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:25.617696 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:25.637946 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Getting quotas for project 01df46301e3d4c75b5399ea41df577bb. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:22:25.643096 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Getting quotas for user 5a4f70bc828241e38d724ca86cc941b9 and project 01df46301e3d4c75b5399ea41df577bb. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:22:25.654142 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: c3cc1362-17f6-4d36-9369-9af00100b07b] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:22:25.655168 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:25.655555 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:25.662935 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: c3cc1362-17f6-4d36-9369-9af00100b07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:22:25.664197 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:25.664863 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:25.695024 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:25.695334 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-2f043bb2-be55-4e48-b117-31d264a69a1f tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:36.435552 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:22:37.453668 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53372. Dec 16 08:22:48.350945 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:22:48.373150 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:48.373556 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:48.419091 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:48.419485 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:48.420225 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:48.420608 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:48.436459 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:22:48.441255 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Getting quotas for user 2c8f2921884d4689bb501a01fd3564da and project 18d8404abbb64519ad9f08b8ce64ea59. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:22:48.454736 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 1f4d8059-ab40-44f4-a1e9-405a5d11a3e1] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:22:48.455689 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:48.456083 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:48.465118 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] [instance: 1f4d8059-ab40-44f4-a1e9-405a5d11a3e1] block_device_mapping [BlockDeviceMapping(attachment_id=32e890c2-3c0c-404e-9190-84f63b939b43,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ec08165-a5cf-4936-b3f1-067694bb69f0',volume_size=1,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:22:48.466478 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:48.466875 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:48.496757 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:22:48.497277 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c60da202-ab41-4688-9606-7cb9c5ea0aec tempest-TestVolumeBootPattern-1262762247 tempest-TestVolumeBootPattern-1262762247-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:22:52.202147 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:22:53.224025 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53466. Dec 16 08:23:08.704573 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:23:08.947722 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-bb828c34-4dbf-4e60-8d8f-269563d00b67 tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:23:08.948198 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-bb828c34-4dbf-4e60-8d8f-269563d00b67 tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:23:08.948586 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-bb828c34-4dbf-4e60-8d8f-269563d00b67 tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:23:09.135208 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-bb828c34-4dbf-4e60-8d8f-269563d00b67 tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] [instance: c3cc1362-17f6-4d36-9369-9af00100b07b] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89856) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:23:09.443163 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-bb828c34-4dbf-4e60-8d8f-269563d00b67 tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Created allocations for migration f88d52e6-9a5e-4be2-a368-0fc088ed4428 on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:23:09.666696 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-bb828c34-4dbf-4e60-8d8f-269563d00b67 tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] [instance: c3cc1362-17f6-4d36-9369-9af00100b07b] Calling prep_resize with selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89856) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:23:11.858598 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:23:50.341323 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:23:51.359688 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53620. Dec 16 08:24:20.217945 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:24:20.243283 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:24:20.243554 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:24:20.294667 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:24:20.295067 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:24:20.295781 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:24:20.296163 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:24:20.312341 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Getting quotas for project 01df46301e3d4c75b5399ea41df577bb. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:24:20.317059 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Getting quotas for user 5a4f70bc828241e38d724ca86cc941b9 and project 01df46301e3d4c75b5399ea41df577bb. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:24:20.328302 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: 65c1c70d-7a2d-4a1e-96ec-d1b73a185868] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:24:20.329432 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:24:20.329948 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:24:20.337270 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: 65c1c70d-7a2d-4a1e-96ec-d1b73a185868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:24:20.338820 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:24:20.339199 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:24:20.366609 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:24:20.367009 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e9b65fb8-1a4a-4577-abb1-7c4e2ec0f4d4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:25:07.801566 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-12fa21a2-1cc6-4c94-9dfb-457b514aef4e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:25:07.802569 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-12fa21a2-1cc6-4c94-9dfb-457b514aef4e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:25:07.803066 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-12fa21a2-1cc6-4c94-9dfb-457b514aef4e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:25:07.923856 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-12fa21a2-1cc6-4c94-9dfb-457b514aef4e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] [instance: 65c1c70d-7a2d-4a1e-96ec-d1b73a185868] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89856) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:25:08.243511 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-12fa21a2-1cc6-4c94-9dfb-457b514aef4e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Created allocations for migration 3f0cffa2-79d3-48a0-9ae4-2c15787acdf9 on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:25:08.624897 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-12fa21a2-1cc6-4c94-9dfb-457b514aef4e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] [instance: 65c1c70d-7a2d-4a1e-96ec-d1b73a185868] Calling prep_resize with selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [] {{(pid=89856) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:25:53.223336 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:25:54.241275 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54076. Dec 16 08:26:25.618833 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:26:25.642340 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:26:25.642693 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:26:25.686512 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:26:25.686823 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:26:25.687524 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:26:25.687898 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:26:25.703107 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Getting quotas for project 01df46301e3d4c75b5399ea41df577bb. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:26:25.707514 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Getting quotas for user 5a4f70bc828241e38d724ca86cc941b9 and project 01df46301e3d4c75b5399ea41df577bb. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:26:25.718073 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: e1a537f0-77a5-418e-93c9-867be86a5615] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:26:25.718950 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:26:25.719329 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:26:25.728129 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: e1a537f0-77a5-418e-93c9-867be86a5615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:26:25.729250 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:26:25.729704 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:26:25.761185 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:26:25.761581 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-cfc0ec81-8e04-43cc-818f-201b3cb3c6e4 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:26:28.734503 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:26:31.884851 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:26:51.360759 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:26:52.377461 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54276. Dec 16 08:27:07.005769 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-88307b7b-c75e-4aa7-bc7d-4d65f667ed9e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:27:07.006406 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-88307b7b-c75e-4aa7-bc7d-4d65f667ed9e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:27:07.006650 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-88307b7b-c75e-4aa7-bc7d-4d65f667ed9e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:27:07.410197 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-88307b7b-c75e-4aa7-bc7d-4d65f667ed9e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Created allocations for migration 0203186a-748c-45a3-bd68-31580e779294 on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:27:07.509219 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.live_migrate [None req-88307b7b-c75e-4aa7-bc7d-4d65f667ed9e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] [instance: e1a537f0-77a5-418e-93c9-867be86a5615] Requesting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while live migrating {{(pid=89856) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:495}} Dec 16 08:27:07.745143 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance [None req-88307b7b-c75e-4aa7-bc7d-4d65f667ed9e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Lazy-loading 'resources' on Instance uuid e1a537f0-77a5-418e-93c9-867be86a5615 {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 08:27:07.749527 n-d-816927-3 nova-conductor[89856]: DEBUG nova.objects.instance [None req-88307b7b-c75e-4aa7-bc7d-4d65f667ed9e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] Lazy-loading 'pci_requests' on Instance uuid e1a537f0-77a5-418e-93c9-867be86a5615 {{(pid=89856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 08:27:08.041178 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.live_migrate [None req-88307b7b-c75e-4aa7-bc7d-4d65f667ed9e tempest-TestNetworkAdvancedServerOps-1968935760 tempest-TestNetworkAdvancedServerOps-1968935760-project-admin] [instance: e1a537f0-77a5-418e-93c9-867be86a5615] Start binding ports on destination host: n-h1-816927-3 {{(pid=89856) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 08:27:41.903922 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:27:41.927846 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:27:41.928330 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:27:41.974775 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:27:41.975175 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:27:41.975885 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:27:41.976267 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:27:41.990981 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Getting quotas for project 01df46301e3d4c75b5399ea41df577bb. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:27:41.995469 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Getting quotas for user 5a4f70bc828241e38d724ca86cc941b9 and project 01df46301e3d4c75b5399ea41df577bb. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:27:42.006076 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: 7d961ff1-e15d-44cc-9a7d-f5476b908f82] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:27:42.007022 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:27:42.007412 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:27:42.014671 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: 7d961ff1-e15d-44cc-9a7d-f5476b908f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:27:42.015949 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:27:42.016454 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:27:42.045735 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:27:42.046162 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-2e0eb1aa-7490-49db-9847-eeb413be7625 tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:28:23.818693 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-48c222db-1375-4b60-ac0a-8e448b9400de tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method rebuild_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:28:23.819246 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-48c222db-1375-4b60-ac0a-8e448b9400de tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:28:23.819716 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-48c222db-1375-4b60-ac0a-8e448b9400de tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:28:23.838497 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-48c222db-1375-4b60-ac0a-8e448b9400de tempest-TestNetworkAdvancedServerOps-603797863 tempest-TestNetworkAdvancedServerOps-603797863-project] [instance: 7d961ff1-e15d-44cc-9a7d-f5476b908f82] No migration record for the rebuild/evacuate request. {{(pid=89856) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 08:29:37.407444 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:29:37.430387 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:29:37.430789 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:29:37.482842 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:29:37.483232 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:29:37.483931 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:29:37.484388 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:29:37.501984 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Getting quotas for project 5a7eb4dec45a45b4b3b7878e32ffedf6. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:29:37.506497 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Getting quotas for user 99ce763fabfd47ca9c0d57612feed339 and project 5a7eb4dec45a45b4b3b7878e32ffedf6. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:29:37.517269 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] [instance: 01f02b0d-ba36-41d7-9531-3247e55ef431] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:29:37.518191 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:29:37.518578 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:29:37.526206 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] [instance: 01f02b0d-ba36-41d7-9531-3247e55ef431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:29:37.527319 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:29:37.527706 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:29:37.554581 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:29:37.554975 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-90cc8216-6d8e-46eb-8872-a46ec485413a tempest-ServersAdminNegativeTestJSON-114951549 tempest-ServersAdminNegativeTestJSON-114951549-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:29:38.062887 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:29:39.080442 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54802. Dec 16 08:29:51.910835 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:29:52.379503 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:29:53.397745 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54886. Dec 16 08:29:54.243311 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:29:55.259906 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54918. Dec 16 08:29:58.318850 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] [01ad0164-d906-407a-8b73-3bc4297dcbbf] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 08:29:59.338078 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] [01ad0164-d906-407a-8b73-3bc4297dcbbf] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54966. Dec 16 08:30:01.604098 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Took 3.29 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:30:01.630934 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:01.631335 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:01.693402 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:01.693816 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:01.694537 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:01.694940 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:01.713159 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Getting quotas for project 4d4aa3e7d85d4a7b9c07257094d4c2b2. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:30:01.717697 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Getting quotas for user 4888586c0c674f0ebb876cb0c629fa2c and project 4d4aa3e7d85d4a7b9c07257094d4c2b2. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:30:01.728503 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] [instance: a5b302a8-fffd-4a4d-b59d-f2655d92249a] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:30:01.729414 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:01.729806 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:01.737047 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] [instance: a5b302a8-fffd-4a4d-b59d-f2655d92249a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:30:01.738251 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:01.738641 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:01.773644 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:01.774071 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-eb2ec1e7-f748-419f-a906-dcd83602117c tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:12.345871 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e7969ff0-e51a-43f6-bf33-804b69e4fcda tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:30:12.346534 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e7969ff0-e51a-43f6-bf33-804b69e4fcda tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:12.346843 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e7969ff0-e51a-43f6-bf33-804b69e4fcda tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:12.576540 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-e7969ff0-e51a-43f6-bf33-804b69e4fcda tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] [instance: a5b302a8-fffd-4a4d-b59d-f2655d92249a] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89857) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:30:12.908206 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-e7969ff0-e51a-43f6-bf33-804b69e4fcda tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] Created allocations for migration e1679b36-9f28-4575-bc4b-ac2183e12846 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:30:13.127656 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-e7969ff0-e51a-43f6-bf33-804b69e4fcda tempest-DeleteServersTestJSON-518721516 tempest-DeleteServersTestJSON-518721516-project] [instance: a5b302a8-fffd-4a4d-b59d-f2655d92249a] Calling prep_resize with selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"094cec38-2c25-455e-a298-721c1f99c6f8": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["094cec38-2c25-455e-a298-721c1f99c6f8"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=094cec38-2c25-455e-a298-721c1f99c6f8,limits=SchedulerLimits,nodename='n-h1-816927-3',service_host='n-h1-816927-3')] {{(pid=89857) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:30:57.022987 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:30:57.046388 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:57.046774 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:57.100502 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:57.100897 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:57.101609 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:57.102032 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:57.118308 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Getting quotas for project f741fea088654c20a1c9feff6aadc800. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:30:57.122913 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Getting quotas for user 4f4d07523fb64b6f9253400e656971f0 and project f741fea088654c20a1c9feff6aadc800. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:30:57.134332 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] [instance: 72941e54-3868-44f5-8268-cf649cab0121] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:30:57.135242 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:57.135631 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:57.143517 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] [instance: 72941e54-3868-44f5-8268-cf649cab0121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:30:57.144672 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:57.145144 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:30:57.172078 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:30:57.172463 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-74222379-3514-4dea-aa74-7739e4a945b3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:08.186621 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-93643fa3-54d2-4500-b020-a7a9f5b29a12 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:31:08.187183 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93643fa3-54d2-4500-b020-a7a9f5b29a12 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:31:08.187469 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-93643fa3-54d2-4500-b020-a7a9f5b29a12 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:08.304879 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-93643fa3-54d2-4500-b020-a7a9f5b29a12 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] [instance: 72941e54-3868-44f5-8268-cf649cab0121] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89857) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:31:08.602352 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-93643fa3-54d2-4500-b020-a7a9f5b29a12 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Created allocations for migration 67ff8a80-20b9-468c-bc01-da49b4e10e72 on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:31:08.831226 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-93643fa3-54d2-4500-b020-a7a9f5b29a12 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] [instance: 72941e54-3868-44f5-8268-cf649cab0121] Calling prep_resize with selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"5b0d4dbc-4f26-40c5-adac-201db72ef7d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5b0d4dbc-4f26-40c5-adac-201db72ef7d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=5b0d4dbc-4f26-40c5-adac-201db72ef7d4,limits=SchedulerLimits,nodename='n-h2-816927-3',service_host='n-h2-816927-3')] {{(pid=89857) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:31:28.757240 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:31:46.543860 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:31:46.565269 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:31:46.565673 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:46.612951 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:31:46.613340 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:46.614092 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:31:46.614469 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:46.629913 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Getting quotas for project f741fea088654c20a1c9feff6aadc800. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:31:46.634486 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Getting quotas for user 4f4d07523fb64b6f9253400e656971f0 and project f741fea088654c20a1c9feff6aadc800. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:31:46.645379 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] [instance: 6753ead8-2608-40c1-8080-458c5b25295c] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:31:46.646238 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:31:46.646619 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:46.655871 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] [instance: 6753ead8-2608-40c1-8080-458c5b25295c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:31:46.657340 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:31:46.657733 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:46.690296 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:31:46.690704 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-d8ae0ebf-5172-479a-9a97-dc74f89e1cd3 tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:56.458776 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-3e2d83ee-1ceb-4b1f-a9b3-247b8fc02c9b tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:31:56.459382 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-3e2d83ee-1ceb-4b1f-a9b3-247b8fc02c9b tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:31:56.459642 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-3e2d83ee-1ceb-4b1f-a9b3-247b8fc02c9b tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:31:56.571718 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-3e2d83ee-1ceb-4b1f-a9b3-247b8fc02c9b tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] [instance: 6753ead8-2608-40c1-8080-458c5b25295c] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89857) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:31:56.869529 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-3e2d83ee-1ceb-4b1f-a9b3-247b8fc02c9b tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] Created allocations for migration ba404e20-2337-4dbe-8e31-09a4a46582e7 on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:31:57.079221 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-3e2d83ee-1ceb-4b1f-a9b3-247b8fc02c9b tempest-ServerDiskConfigTestJSON-1243162042 tempest-ServerDiskConfigTestJSON-1243162042-project] [instance: 6753ead8-2608-40c1-8080-458c5b25295c] Calling prep_resize with selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"094cec38-2c25-455e-a298-721c1f99c6f8": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["094cec38-2c25-455e-a298-721c1f99c6f8"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=094cec38-2c25-455e-a298-721c1f99c6f8,limits=SchedulerLimits,nodename='n-h1-816927-3',service_host='n-h1-816927-3')] {{(pid=89857) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:32:50.212219 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:32:50.237847 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:32:50.238281 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:32:50.293982 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:32:50.294371 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:32:50.295119 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:32:50.295492 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:32:50.310695 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Getting quotas for project 1089c423660d4b0d9d11ed451f401a41. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:32:50.315970 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Getting quotas for user 5401799b9bc1445981cd26104f28b72b and project 1089c423660d4b0d9d11ed451f401a41. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:32:50.327198 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 0db14597-6fde-4fc9-94ab-9f31dcb1db71] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:32:50.328149 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:32:50.328533 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:32:50.336882 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 0db14597-6fde-4fc9-94ab-9f31dcb1db71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:32:50.338087 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:32:50.338474 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:32:50.373061 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:32:50.373597 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-188ad84f-fb8c-46e5-b41b-9587edb24dc9 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:32:53.399194 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:32:54.419676 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55614. Dec 16 08:32:55.262077 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:32:56.278354 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55622. Dec 16 08:33:11.935783 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:34:15.405253 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:34:16.432329 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55778. Dec 16 08:34:37.465251 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:34:38.482445 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55820. Dec 16 08:34:41.032562 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-13c93349-e35b-4215-9f46-7d9fa7eae2f4 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:34:41.033094 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-13c93349-e35b-4215-9f46-7d9fa7eae2f4 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:34:41.033410 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-13c93349-e35b-4215-9f46-7d9fa7eae2f4 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:34:41.252889 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-13c93349-e35b-4215-9f46-7d9fa7eae2f4 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 0db14597-6fde-4fc9-94ab-9f31dcb1db71] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89856) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:34:41.657732 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-13c93349-e35b-4215-9f46-7d9fa7eae2f4 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Created allocations for migration 53bade09-f080-448f-ba2a-942b72d96c05 on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:34:41.883443 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-13c93349-e35b-4215-9f46-7d9fa7eae2f4 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 0db14597-6fde-4fc9-94ab-9f31dcb1db71] Calling prep_resize with selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"5b0d4dbc-4f26-40c5-adac-201db72ef7d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5b0d4dbc-4f26-40c5-adac-201db72ef7d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=5b0d4dbc-4f26-40c5-adac-201db72ef7d4,limits=SchedulerLimits,nodename='n-h2-816927-3',service_host='n-h2-816927-3')] {{(pid=89856) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:34:48.777633 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:35:10.776037 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [4ee01989-7be9-40f4-9ce0-4cb9dc936058] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 08:35:11.797420 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [4ee01989-7be9-40f4-9ce0-4cb9dc936058] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55954. Dec 16 08:35:14.009679 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:35:14.202055 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Took 3.43 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:35:14.225175 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:35:14.225578 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:35:14.272989 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:35:14.273376 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:35:14.274136 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:35:14.274510 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:35:14.289964 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Getting quotas for project 1089c423660d4b0d9d11ed451f401a41. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:35:14.294432 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Getting quotas for user 5401799b9bc1445981cd26104f28b72b and project 1089c423660d4b0d9d11ed451f401a41. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:35:14.305042 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: a4cf9617-3647-4bf5-98e3-1360315729c6] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:35:14.305951 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:35:14.306334 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:35:14.314673 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: a4cf9617-3647-4bf5-98e3-1360315729c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:35:14.315896 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:35:14.316289 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:35:14.348672 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:35:14.349207 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-9bd2a166-8e6f-413a-9d70-ad8fdfcd5445 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:35:54.418197 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:35:55.442741 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56062. Dec 16 08:35:56.279186 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:35:57.298099 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56066. Dec 16 08:36:31.962905 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:37:13.657175 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-50f8b32e-c16e-4be8-808c-6e97d67d69de tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:37:13.657744 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-50f8b32e-c16e-4be8-808c-6e97d67d69de tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:37:13.657990 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-50f8b32e-c16e-4be8-808c-6e97d67d69de tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:37:13.769357 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-50f8b32e-c16e-4be8-808c-6e97d67d69de tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: a4cf9617-3647-4bf5-98e3-1360315729c6] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89856) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:37:14.094741 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-50f8b32e-c16e-4be8-808c-6e97d67d69de tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Created allocations for migration 6283adf3-5a3f-42bf-b952-2886535f8f4c on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:37:14.480848 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-50f8b32e-c16e-4be8-808c-6e97d67d69de tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: a4cf9617-3647-4bf5-98e3-1360315729c6] Calling prep_resize with selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"094cec38-2c25-455e-a298-721c1f99c6f8": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["094cec38-2c25-455e-a298-721c1f99c6f8"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=094cec38-2c25-455e-a298-721c1f99c6f8,limits=SchedulerLimits,nodename='n-h1-816927-3',service_host='n-h1-816927-3')] {{(pid=89856) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:37:16.429298 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:37:17.451281 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56256. Dec 16 08:37:34.447265 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:37:34.469603 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:37:34.470050 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:37:34.518672 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:37:34.519075 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:37:34.519796 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:37:34.520183 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:37:34.535765 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Getting quotas for project 1089c423660d4b0d9d11ed451f401a41. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:37:34.540695 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Getting quotas for user 5401799b9bc1445981cd26104f28b72b and project 1089c423660d4b0d9d11ed451f401a41. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:37:34.551247 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 5d733095-fea8-4c6d-9fe9-984214b7622b] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:37:34.552148 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:37:34.552549 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:37:34.561436 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 5d733095-fea8-4c6d-9fe9-984214b7622b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:37:34.563123 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:37:34.563686 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:37:34.594617 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:37:34.595017 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-8b56b23c-da0e-4fcf-bb18-653616d1a716 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:37:38.483924 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:37:39.505864 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56338. Dec 16 08:38:08.800135 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:38:34.032950 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:38:55.443837 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:38:56.461373 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56500. Dec 16 08:38:57.299170 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:38:58.314774 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56504. Dec 16 08:39:23.896972 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-0f71086a-e324-4f26-8d50-cff5e4bf5b66 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:39:23.897620 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0f71086a-e324-4f26-8d50-cff5e4bf5b66 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:39:23.898157 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-0f71086a-e324-4f26-8d50-cff5e4bf5b66 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:39:24.091957 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-0f71086a-e324-4f26-8d50-cff5e4bf5b66 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 5d733095-fea8-4c6d-9fe9-984214b7622b] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89857) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:39:24.394468 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-0f71086a-e324-4f26-8d50-cff5e4bf5b66 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Created allocations for migration 36b8b6bb-f6d8-437a-a3d3-65a6f146790c on 094cec38-2c25-455e-a298-721c1f99c6f8 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:39:24.400461 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f71086a-e324-4f26-8d50-cff5e4bf5b66 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [4ee01989-7be9-40f4-9ce0-4cb9dc936058] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 08:39:25.422552 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f71086a-e324-4f26-8d50-cff5e4bf5b66 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [4ee01989-7be9-40f4-9ce0-4cb9dc936058] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56578. Dec 16 08:39:26.663103 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-0f71086a-e324-4f26-8d50-cff5e4bf5b66 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 5d733095-fea8-4c6d-9fe9-984214b7622b] Calling prep_resize with selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"094cec38-2c25-455e-a298-721c1f99c6f8": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["094cec38-2c25-455e-a298-721c1f99c6f8"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=094cec38-2c25-455e-a298-721c1f99c6f8,limits=SchedulerLimits,nodename='n-h1-816927-3',service_host='n-h1-816927-3')] {{(pid=89857) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:39:39.088039 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:39:40.105151 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56610. Dec 16 08:39:51.989404 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:40:01.171091 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [01ad0164-d906-407a-8b73-3bc4297dcbbf] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 08:40:02.186320 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [01ad0164-d906-407a-8b73-3bc4297dcbbf] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56686. Dec 16 08:40:04.439144 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Took 3.27 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:40:04.469440 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:40:04.469866 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:40:04.520443 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:40:04.520829 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:40:04.521554 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:40:04.522031 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:40:04.538546 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Getting quotas for project 1089c423660d4b0d9d11ed451f401a41. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:40:04.545345 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Getting quotas for user 5401799b9bc1445981cd26104f28b72b and project 1089c423660d4b0d9d11ed451f401a41. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:40:04.557349 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 17e5b15a-9d6c-400e-88ff-663eaff5e096] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:40:04.558311 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:40:04.559536 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:40:04.567705 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 17e5b15a-9d6c-400e-88ff-663eaff5e096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:40:04.568988 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:40:04.569374 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:40:04.607407 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:40:04.607841 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:40:04.617689 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [20bf1243-5697-41da-88c8-d8919293e4ae] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 08:40:05.636369 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f627c86-b15b-4fa7-8720-1a2fc1e2f364 tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [20bf1243-5697-41da-88c8-d8919293e4ae] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56706. Dec 16 08:41:28.830484 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:41:39.509349 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:41:40.533181 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56896. Dec 16 08:41:54.060937 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:41:56.462546 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:41:57.481278 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56938. Dec 16 08:41:58.316149 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:41:59.333800 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56954. Dec 16 08:42:06.771401 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-4b0af874-33a0-422b-b69b-5cd434d47fdd tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89857) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:42:06.772088 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4b0af874-33a0-422b-b69b-5cd434d47fdd tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:42:06.772417 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-4b0af874-33a0-422b-b69b-5cd434d47fdd tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:42:06.898582 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-4b0af874-33a0-422b-b69b-5cd434d47fdd tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 17e5b15a-9d6c-400e-88ff-663eaff5e096] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89857) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:42:07.316897 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-4b0af874-33a0-422b-b69b-5cd434d47fdd tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] Created allocations for migration c6497aaa-92af-44f0-80fc-c0b35bd06ed3 on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89857) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:42:07.708446 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.tasks.migrate [None req-4b0af874-33a0-422b-b69b-5cd434d47fdd tempest-ServerActionsTestJSON-530287325 tempest-ServerActionsTestJSON-530287325-project] [instance: 17e5b15a-9d6c-400e-88ff-663eaff5e096] Calling prep_resize with selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"5b0d4dbc-4f26-40c5-adac-201db72ef7d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5b0d4dbc-4f26-40c5-adac-201db72ef7d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=5b0d4dbc-4f26-40c5-adac-201db72ef7d4,limits=SchedulerLimits,nodename='n-h2-816927-3',service_host='n-h2-816927-3')] {{(pid=89857) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:42:14.379555 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:42:15.411340 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57024. Dec 16 08:42:40.106023 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:42:41.122386 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57084. Dec 16 08:43:12.014398 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:43:13.036993 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:43:13.061185 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:13.061670 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:13.121946 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:13.122367 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:13.123139 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:13.123520 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:13.139200 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Getting quotas for project 5a24c4705404490ea032de0945e8c4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:43:13.143915 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Getting quotas for user bfb4a61730b24a1596654b05e10c90a0 and project 5a24c4705404490ea032de0945e8c4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:43:13.155356 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] [instance: 0a5bf133-d5cc-4062-9086-f40a88407ce7] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:43:13.156398 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:13.156794 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:13.165611 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] [instance: 0a5bf133-d5cc-4062-9086-f40a88407ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:43:13.166946 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:13.167422 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:13.201427 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:13.201758 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-95807dd2-c5b1-4d6a-ae02-4771eff29211 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:24.978313 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:43:25.000211 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:25.000600 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:25.048397 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:25.048794 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:25.049504 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:25.049921 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:25.066508 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Getting quotas for project 5a24c4705404490ea032de0945e8c4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:43:25.071953 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Getting quotas for user bfb4a61730b24a1596654b05e10c90a0 and project 5a24c4705404490ea032de0945e8c4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:43:25.083424 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] [instance: 94f9108c-e752-4653-91c8-008e942b8998] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:43:25.084907 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:25.085302 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:25.092340 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] [instance: 94f9108c-e752-4653-91c8-008e942b8998] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:43:25.093619 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:25.094040 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:43:25.120615 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:43:25.121010 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-467d073f-b2c3-4c8d-aa67-70e3be0373d5 tempest-ServersNegativeTestJSON-734532102 tempest-ServersNegativeTestJSON-734532102-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:44:29.782331 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:44:29.806503 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:44:29.806924 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:44:29.873495 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:44:29.873929 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:44:29.874728 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:44:29.875168 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:44:29.892899 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Getting quotas for project f8765a51e55948599bb06d3c7cf819e1. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:44:29.898400 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Getting quotas for user 2a1228640bfb49d3923c7aa7fd17dcce and project f8765a51e55948599bb06d3c7cf819e1. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:44:29.909631 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] [instance: dc608d3f-decc-4b54-b935-274f88631275] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:44:29.910620 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:44:29.911017 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:44:29.919452 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] [instance: dc608d3f-decc-4b54-b935-274f88631275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:44:29.920686 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:44:29.921100 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:44:29.949872 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:44:29.950270 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-502f0c1b-4be6-4e1c-8b2f-067f4f6f1422 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:44:48.854295 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:44:57.484772 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:44:58.502183 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57812. Dec 16 08:44:59.335833 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:45:00.354188 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57820. Dec 16 08:45:02.480301 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:45:02.503567 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:45:02.504011 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:45:02.550051 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:45:02.550365 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:45:02.551080 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:45:02.551465 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:45:02.566666 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Getting quotas for project f8765a51e55948599bb06d3c7cf819e1. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:45:02.571917 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Getting quotas for user 2a1228640bfb49d3923c7aa7fd17dcce and project f8765a51e55948599bb06d3c7cf819e1. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:45:02.582339 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] [instance: 609dba3b-c0bb-44a8-a7f6-bc52078331a6] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:45:02.583264 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:45:02.583655 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:45:02.591222 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] [instance: 609dba3b-c0bb-44a8-a7f6-bc52078331a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:45:02.592589 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:45:02.593069 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:45:02.624017 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:45:02.624443 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-92fe17ca-ce3f-4003-8326-9d0b6544cd58 tempest-TestEncryptedCinderVolumes-1756084706 tempest-TestEncryptedCinderVolumes-1756084706-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:46:12.026976 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:46:12.049823 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:46:12.050221 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:46:12.119796 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:46:12.120101 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:46:12.120810 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:46:12.121188 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:46:12.136661 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Getting quotas for project 42c68574eb1e464bb47f3a83d91015f8. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:46:12.142054 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Getting quotas for user 3a883d4dd97d45049ca0dcc166d74517 and project 42c68574eb1e464bb47f3a83d91015f8. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:46:12.152330 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] [instance: e3bd29b3-0086-4db0-80ff-4d1c1ff5c2b5] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:46:12.153218 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:46:12.153602 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:46:12.162344 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] [instance: e3bd29b3-0086-4db0-80ff-4d1c1ff5c2b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3e29e1e6-6c79-4c50-84a3-97f062a76c55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:46:12.163710 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:46:12.163977 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:46:12.192913 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:46:12.193331 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-51110458-b972-454c-808e-252d1ea84557 tempest-TestMinimumBasicScenario-1997904616 tempest-TestMinimumBasicScenario-1997904616-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:46:32.039518 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:47:15.408360 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:47:16.435258 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58344. Dec 16 08:47:41.126060 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:47:42.149460 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58356. Dec 16 08:47:58.504016 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:47:59.521034 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58398. Dec 16 08:48:00.355591 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:48:01.377479 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58406. Dec 16 08:48:08.878533 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:48:17.455197 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:48:18.482362 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58518. Dec 16 08:48:30.691816 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:48:30.719044 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:48:30.719456 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:48:30.774109 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:48:30.774109 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:48:30.774961 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:48:30.775440 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:48:30.792676 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:48:30.797504 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for user 79184b0b06704b7c8792b4f7b374de92 and project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:48:30.808228 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 2d7ddf77-2404-4260-95e6-58b4d73a509e] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:48:30.809169 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:48:30.809569 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:48:30.816386 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 2d7ddf77-2404-4260-95e6-58b4d73a509e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:48:30.817454 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:48:30.817868 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:48:30.848749 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:48:30.849214 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-e9a93263-9873-4341-b12c-494fd2f4ae81 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:48:32.604210 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:48:40.536882 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:48:41.557768 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58672. Dec 16 08:49:43.208843 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:49:43.233611 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:49:43.234110 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:49:43.287614 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:49:43.288021 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:49:43.288733 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:49:43.289113 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:49:43.305322 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:49:43.309879 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for user 79184b0b06704b7c8792b4f7b374de92 and project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:49:43.320482 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 8b7c55c2-4c8b-4b25-8a00-3b99f0e340cd] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:49:43.321430 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:49:43.321812 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:49:43.329242 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 8b7c55c2-4c8b-4b25-8a00-3b99f0e340cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:49:43.330439 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:49:43.330816 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:49:43.358168 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:49:43.358558 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-13b3f84c-be48-4e0a-a290-396860f2a7f6 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:49:52.065484 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:50:42.149215 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:50:43.169587 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58968. Dec 16 08:50:59.522765 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:51:00.539868 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58970. Dec 16 08:51:01.379855 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:51:02.396700 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58972. Dec 16 08:51:16.431678 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:51:17.455794 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59006. Dec 16 08:51:28.899007 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:51:33.341393 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:51:33.369216 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:51:33.369608 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:51:33.423923 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:51:33.424404 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:51:33.425110 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:51:33.425535 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:51:33.442861 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:51:33.447629 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for user 79184b0b06704b7c8792b4f7b374de92 and project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:51:33.458332 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 740bf71e-c437-4458-b9cd-34646e85263e] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:51:33.459417 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:51:33.459797 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:51:33.469513 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 740bf71e-c437-4458-b9cd-34646e85263e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:51:33.471040 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:51:33.471498 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:51:33.501351 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:51:33.501810 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-11b25e8e-f184-4bba-b267-c826e643f13b tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:52:16.668338 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-b41fb4f0-fe11-42a3-8b32-758b96bdbe50 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method migrate_server {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:52:16.669218 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b41fb4f0-fe11-42a3-8b32-758b96bdbe50 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:52:16.669218 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-b41fb4f0-fe11-42a3-8b32-758b96bdbe50 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:52:16.959363 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-b41fb4f0-fe11-42a3-8b32-758b96bdbe50 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 740bf71e-c437-4458-b9cd-34646e85263e] Restricting to cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) while migrating {{(pid=89856) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 08:52:17.335894 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-b41fb4f0-fe11-42a3-8b32-758b96bdbe50 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Created allocations for migration b1db5d9a-4fdc-47d3-a4e9-421971d4c6cc on 5b0d4dbc-4f26-40c5-adac-201db72ef7d4 {{(pid=89856) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 08:52:17.578090 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.tasks.migrate [None req-b41fb4f0-fe11-42a3-8b32-758b96bdbe50 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 740bf71e-c437-4458-b9cd-34646e85263e] Calling prep_resize with selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [Selection(allocation_request='{"allocations": {"5b0d4dbc-4f26-40c5-adac-201db72ef7d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5b0d4dbc-4f26-40c5-adac-201db72ef7d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=af4b7ade-c03d-4345-95e5-9b405ba8c838,compute_node_uuid=5b0d4dbc-4f26-40c5-adac-201db72ef7d4,limits=SchedulerLimits,nodename='n-h2-816927-3',service_host='n-h2-816927-3')] {{(pid=89856) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 08:53:12.085501 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:53:27.199758 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:53:27.222844 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:53:27.223360 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:53:27.280462 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:53:27.280855 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:53:27.281566 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:53:27.281992 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:53:27.298665 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:53:27.303762 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for user 79184b0b06704b7c8792b4f7b374de92 and project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:53:27.315579 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: c0dc3e2d-0810-4834-a857-63b4433295f2] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:53:27.316555 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:53:27.316945 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:53:27.324446 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: c0dc3e2d-0810-4834-a857-63b4433295f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:53:27.325700 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:53:27.326167 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:53:27.358043 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:53:27.358356 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-e6f59bfe-731f-4f55-bbcd-f56c14f78fac tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:54:00.541346 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:54:01.558882 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59446. Dec 16 08:54:02.399665 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:54:03.423869 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59452. Dec 16 08:54:17.450869 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:54:18.473816 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59478. Dec 16 08:54:43.172295 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:54:44.188897 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59502. Dec 16 08:54:48.929671 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:55:15.639765 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:55:15.662776 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:55:15.663089 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:55:15.710326 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:55:15.710943 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:55:15.711905 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:55:15.712338 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:55:15.728599 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:55:15.733240 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Getting quotas for user 79184b0b06704b7c8792b4f7b374de92 and project 9b1b337a3ca1420bbd0f8a5fb14ea247. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:55:15.743840 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 08e3d730-f77b-4c86-ba9e-d387f0adfb69] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:55:15.744782 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:55:15.745163 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:55:15.752814 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] [instance: 08e3d730-f77b-4c86-ba9e-d387f0adfb69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:55:15.753721 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:55:15.754135 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:55:15.783862 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:55:15.784293 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-270f3675-e13f-43b0-b9d3-4b8c760b81b3 tempest-TestNetworkAdvancedServerOps-1325330785 tempest-TestNetworkAdvancedServerOps-1325330785-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:55:16.158337 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:55:17.618446 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:56:32.106145 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:56:33.622463 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:56:33.646382 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:56:33.646774 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:56:33.696755 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:56:33.697152 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:56:33.698013 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:56:33.698400 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:56:33.716386 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Getting quotas for project 23e0686e3777488583c8b2e5bfc7e5ef. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 08:56:33.720980 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Getting quotas for user 8bc14d51bcb74b7f8c3ec94a477ce837 and project 23e0686e3777488583c8b2e5bfc7e5ef. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 08:56:33.731684 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] [instance: 51853a8f-b377-471b-a4f4-00c10a6ac86e] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 08:56:33.732606 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:56:33.732996 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:56:33.740382 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] [instance: 51853a8f-b377-471b-a4f4-00c10a6ac86e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 08:56:33.741694 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:56:33.742109 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:56:33.770328 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:56:33.770721 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-791e8b74-0dd6-44a6-bf27-fdc23d437070 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:57:01.559761 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:57:02.578227 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59982. Dec 16 08:57:03.423881 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 08:57:04.440308 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59984. Dec 16 08:57:18.481196 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:57:19.504811 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59992. Dec 16 08:57:41.565327 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:57:42.581814 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59998. Dec 16 08:58:08.950604 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:58:32.645737 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:58:34.117082 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 08:58:44.193169 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 08:58:45.211170 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60040. Dec 16 08:59:12.245282 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0453a472-7236-41e1-9185-2cb74f934353 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method unshelve_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 08:59:12.246026 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0453a472-7236-41e1-9185-2cb74f934353 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 08:59:12.246242 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-0453a472-7236-41e1-9185-2cb74f934353 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 08:59:12.566513 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0453a472-7236-41e1-9185-2cb74f934353 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] [instance: 51853a8f-b377-471b-a4f4-00c10a6ac86e] Requesting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) during scheduling {{(pid=89856) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 08:59:12.790883 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-0453a472-7236-41e1-9185-2cb74f934353 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 08:59:52.127304 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:00:02.578840 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:00:03.596187 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60232. Dec 16 09:00:04.441481 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:00:05.459497 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60238. Dec 16 09:00:19.499939 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:00:20.531219 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60240. Dec 16 09:00:42.583059 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:00:43.602166 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60246. Dec 16 09:01:10.282044 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 09:01:10.309376 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:01:10.309376 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:01:10.362127 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:01:10.362622 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:01:10.363346 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:01:10.363737 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:01:10.380197 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Getting quotas for project 23e0686e3777488583c8b2e5bfc7e5ef. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 09:01:10.385928 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Getting quotas for user 8bc14d51bcb74b7f8c3ec94a477ce837 and project 23e0686e3777488583c8b2e5bfc7e5ef. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 09:01:10.399306 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] [instance: 2a7d392f-4d99-40de-bd04-64e0b855b22b] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 09:01:10.400168 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:01:10.400563 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:01:10.409509 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] [instance: 2a7d392f-4d99-40de-bd04-64e0b855b22b] block_device_mapping [BlockDeviceMapping(attachment_id=199b0f6b-0777-450d-9204-55fec1596a17,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73f23a08-37d1-4b97-87b4-d486d437f5a4',volume_size=1,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 09:01:10.411086 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:01:10.411498 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:01:10.446577 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:01:10.447028 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-a9def1ea-024f-4011-b71b-29ffd825d5cb tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:01:28.970587 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:01:52.666707 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:01:54.139085 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:03:03.597834 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:03:04.617196 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60490. Dec 16 09:03:05.460288 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:03:06.490906 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60492. Dec 16 09:03:12.151741 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:03:18.477267 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:03:19.507181 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60498. Dec 16 09:03:20.525499 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:03:21.552242 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60500. Dec 16 09:03:36.187692 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:03:37.690166 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:03:39.785252 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-54e91e77-9523-4f42-b149-a5f935b5fd06 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Targeting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) for conductor method unshelve_instance {{(pid=89856) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 09:03:39.786022 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54e91e77-9523-4f42-b149-a5f935b5fd06 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:03:39.786199 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54e91e77-9523-4f42-b149-a5f935b5fd06 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:03:40.021238 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-54e91e77-9523-4f42-b149-a5f935b5fd06 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] [instance: 2a7d392f-4d99-40de-bd04-64e0b855b22b] Requesting cell af4b7ade-c03d-4345-95e5-9b405ba8c838(cell1) during scheduling {{(pid=89856) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 09:03:40.622100 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-54e91e77-9523-4f42-b149-a5f935b5fd06 tempest-TestShelveInstance-388372743 tempest-TestShelveInstance-388372743-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 09:03:43.602882 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:03:44.621685 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60574. Dec 16 09:04:48.990880 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:05:12.692655 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:05:14.167789 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:05:45.216154 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:05:46.247595 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60744. Dec 16 09:06:02.531016 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89857) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 09:06:02.555461 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:06:02.555848 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:06:02.615200 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:06:02.615595 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:06:02.616316 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:06:02.616702 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:06:02.635629 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Getting quotas for project 83020ec1f863406e9cec44ab44082c74. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 09:06:02.640871 n-d-816927-3 nova-conductor[89857]: DEBUG nova.quota [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Getting quotas for user 716cecd0c1b84ba4babe95a9bcfa0b49 and project 83020ec1f863406e9cec44ab44082c74. Resources: {'ram', 'instances', 'cores'} {{(pid=89857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 09:06:02.652824 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] [instance: 12b1f6c5-d333-412b-9356-cade6ffd00ba] Selected host: n-h2-816927-3; Selected node: n-h2-816927-3; Alternates: [('n-h1-816927-3', 'n-h1-816927-3')] {{(pid=89857) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 09:06:02.653803 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:06:02.654201 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:06:02.663011 n-d-816927-3 nova-conductor[89857]: DEBUG nova.conductor.manager [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] [instance: 12b1f6c5-d333-412b-9356-cade6ffd00ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='054fc74a-92c8-4830-9090-85a9df554ae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89857) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 09:06:02.664422 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:06:02.664857 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:06:02.700006 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:06:02.700391 n-d-816927-3 nova-conductor[89857]: DEBUG oslo_concurrency.lockutils [None req-c621c116-eb8e-4040-9aca-9cf44d5468ec tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:06:04.619115 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:06:05.640701 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60840. Dec 16 09:06:06.481572 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:06:07.508307 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60850. Dec 16 09:06:19.499791 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:06:20.525867 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60884. Dec 16 09:06:32.180359 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:06:56.210170 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:06:57.714547 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:08:09.014372 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:08:21.551225 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:08:22.584396 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60970. Dec 16 09:08:31.970004 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89856) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 09:08:32.005730 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:08:32.006255 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:08:32.090718 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:08:32.091469 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:08:32.092625 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:08:32.093301 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:08:32.124745 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Getting quotas for project 83020ec1f863406e9cec44ab44082c74. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 09:08:32.139522 n-d-816927-3 nova-conductor[89856]: DEBUG nova.quota [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Getting quotas for user 716cecd0c1b84ba4babe95a9bcfa0b49 and project 83020ec1f863406e9cec44ab44082c74. Resources: {'ram', 'instances', 'cores'} {{(pid=89856) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 09:08:32.153049 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] [instance: aa5ee2ed-5803-4324-a029-8dd7c97c3cd9] Selected host: n-h1-816927-3; Selected node: n-h1-816927-3; Alternates: [('n-h2-816927-3', 'n-h2-816927-3')] {{(pid=89856) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 09:08:32.154049 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:08:32.154440 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:08:32.163367 n-d-816927-3 nova-conductor[89856]: DEBUG nova.conductor.manager [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] [instance: aa5ee2ed-5803-4324-a029-8dd7c97c3cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3e525bc5-5606-4da6-a6bf-5043a7c0f4b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89856) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 09:08:32.164653 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:08:32.165062 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:08:32.210185 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 09:08:32.210822 n-d-816927-3 nova-conductor[89856]: DEBUG oslo_concurrency.lockutils [None req-54702ba3-4d76-477f-95c8-448332d9ac47 tempest-TestSnapshotPattern-1035767188 tempest-TestSnapshotPattern-1035767188-project] Lock "af4b7ade-c03d-4345-95e5-9b405ba8c838" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 09:08:32.719266 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:08:34.189645 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:08:44.630541 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:08:45.649594 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32864. Dec 16 09:09:05.639568 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:09:06.660699 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32898. Dec 16 09:09:07.509236 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:09:08.531029 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32900. Dec 16 09:09:52.204239 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:10:46.253633 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:10:47.270581 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33120. Dec 16 09:11:20.536935 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:11:21.559624 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33180. Dec 16 09:11:22.576355 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:11:23.599318 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33182. Dec 16 09:11:29.044442 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:11:45.651451 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:11:46.669352 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33186. Dec 16 09:11:52.755113 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:11:54.215304 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:12:06.657969 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:12:07.675079 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33196. Dec 16 09:12:08.531848 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:12:09.549843 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33198. Dec 16 09:13:12.226656 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:13:36.237577 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:13:37.739813 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:13:47.274000 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:13:48.293584 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33210. Dec 16 09:14:21.555227 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:14:22.578025 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33216. Dec 16 09:14:23.595269 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:14:24.622502 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33218. Dec 16 09:14:46.671157 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:14:47.687975 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33220. Dec 16 09:14:49.066412 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:15:07.675650 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:15:08.692790 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33224. Dec 16 09:15:09.550863 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:15:10.568814 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33226. Dec 16 09:15:12.784448 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:15:14.235253 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:16:32.251590 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:16:48.294531 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:16:49.312463 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2756baa-34e6-4072-8f3f-59c9c34d7bd9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33242. Dec 16 09:16:56.258479 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:16:57.761125 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:17:22.574298 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 09:17:23.600379 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [e92c813b-913a-4ca6-b49b-af14873ad74a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33256. Dec 16 09:17:24.614306 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:17:25.638054 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2c4cee-6155-4747-b8e6-ef9ac3faf91e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33258. Dec 16 09:17:47.689802 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:17:48.713015 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdc62aa0-cc52-4b86-87ba-d51b757bf919] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33260. Dec 16 09:18:08.694325 n-d-816927-3 nova-conductor[89857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:18:09.085548 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:18:09.716919 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] [da2d8471-f0a7-436f-810f-a8033b2de4cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33264. Dec 16 09:18:10.570111 n-d-816927-3 nova-conductor[89856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 09:18:11.594486 n-d-816927-3 nova-conductor[89856]: INFO oslo.messaging._drivers.impl_rabbit [-] [41160553-4ad4-4d30-a319-02fe4ee88568] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33266. Dec 16 09:18:32.813735 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 09:18:34.257706 n-d-816927-3 nova-conductor[89857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer